Jun 04 06:19:04 devstack cinder-volume[75426]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75426) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 04 06:19:04 devstack cinder-volume[75426]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75426) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 04 06:19:04 devstack cinder-volume[75426]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75426) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 04 06:19:05 devstack cinder-volume[75426]: INFO dbcounter [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] Registered counter for database cinder Jun 04 06:19:05 devstack cinder-volume[75426]: DEBUG oslo_db.sqlalchemy.engines [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75426) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 06:19:05 devstack cinder-volume[75426]: DEBUG dbcounter [-] [75426] Writer thread running {{(pid=75426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 04 06:19:05 devstack cinder-volume[75426]: INFO cinder.rpc [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 04 06:19:05 devstack cinder-volume[75426]: INFO cinder.rpc [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 04 06:19:05 devstack cinder-volume[75426]: DEBUG oslo_db.sqlalchemy.engines [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75426) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 06:19:05 devstack cinder-volume[75426]: INFO cinder.volume.manager [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] Determined volume DB was empty at startup. Jun 04 06:19:05 devstack cinder-volume[75426]: DEBUG cinder.volume.manager [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75426) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 04 06:19:05 devstack cinder-volume[75426]: INFO cinder.volume.manager [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 04 06:19:05 devstack cinder-volume[75426]: WARNING stevedore.named [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 04 06:19:05 devstack cinder-volume[75426]: WARNING castellan.key_manager [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 04 06:19:05 devstack cinder-volume[75426]: WARNING cinder.keymgr.conf_key_mgr [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 04 06:19:05 devstack cinder-volume[75426]: DEBUG cinder.volume.drivers.lvm [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75426) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 04 06:19:05 devstack cinder-volume[75426]: DEBUG oslo_concurrency.processutils [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:19:05 devstack cinder-volume[75426]: DEBUG oslo_concurrency.processutils [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] CMD "cinder-rtstool verify" returned: 0 in 0.394s {{(pid=75426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:19:05 devstack cinder-volume[75426]: DEBUG oslo_db.sqlalchemy.engines [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75426) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 06:19:05 devstack cinder-volume[75426]: INFO cinder.rpc [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 04 06:19:05 devstack cinder-volume[75426]: INFO cinder.rpc [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 04 06:19:05 devstack cinder-volume[75426]: WARNING stevedore.named [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 04 06:19:05 devstack cinder-volume[75426]: WARNING castellan.key_manager [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 04 06:19:05 devstack cinder-volume[75426]: INFO cinder.volume.manager [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 04 06:19:05 devstack cinder-volume[75426]: DEBUG oslo_db.sqlalchemy.engines [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75426) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 06:19:06 devstack cinder-volume[75426]: INFO oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] Starting 1 workers Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] Started child 75602 {{(pid=75426) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] Full set of CONF: {{(pid=75426) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] ******************************************************************************** {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] Configuration options gathered from: {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] ================================================================================ {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] allow_availability_zone_fallback = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] allow_compression_on_image_upload = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] allowed_direct_url_schemes = [] {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] api_rate_limit = True {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] auth_strategy = keystone {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] az_cache_duration = 3600 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_availability_zone = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_host = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_name = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_stats_polling_interval = 60 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backup_api_class = cinder.backup.api.API {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backup_name_template = backup-%s {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backup_use_same_host = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backup_use_temp_snapshot = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] chap_password = **** {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] chap_username = {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cinder_internal_tenant_project_id = 2328755ba72947f0b99445636a345078 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cinder_internal_tenant_user_id = 94437284f3de45d58e340160525efc6c {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cloned_volume_same_az = True {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cluster = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] compression_format = gzip {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] compute_api_class = cinder.compute.nova.API {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] config_dir = [] {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] config_source = [] {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] control_exchange = openstack {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] debug = True {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] default_availability_zone = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] default_group_type = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] default_volume_type = lvmdriver-1 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] disk_geometry = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] driver_client_cert = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] driver_client_cert_key = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] driver_data_namespace = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75602]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] driver_ssl_cert_path = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] driver_ssl_cert_verify = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] driver_use_ssl = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] enable_force_upload = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] enable_new_services = True {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] enable_unsupported_driver = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] enforce_multipath_for_image_xfer = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] filter_function = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] glance_api_insecure = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] glance_api_servers = ['http://192.168.122.209/image'] {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] glance_api_ssl_compression = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] glance_ca_certificates_file = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] glance_catalog_info = image:glance:publicURL {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] glance_certfile = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] glance_keyfile = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] glance_num_retries = 3 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] glance_request_timeout = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] goodness_function = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] graceful_shutdown_timeout = 5 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] group_api_class = cinder.group.api.API {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] host = devstack {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] image_compress_on_upload = True {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] image_conversion_address_space_limit = 1 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] image_conversion_cpu_limit = 60 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] image_conversion_disable = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] image_upload_use_cinder_backend = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] image_upload_use_internal_tenant = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] image_volume_cache_enabled = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] image_volume_cache_max_count = 0 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] image_volume_cache_max_size_gb = 0 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] init_host_max_objects_retrieval = 0 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] instance_format = [instance: %(uuid)s] {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] iscsi_target_flags = {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] iscsi_write_cache = on {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] iser_helper = tgtadm {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] iser_ip_address = 192.168.122.209 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] iser_port = 3260 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] log_color = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] log_config_append = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] log_dir = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] log_file = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] log_options = True {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] log_rotate_interval = 1 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] log_rotate_interval_type = days {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] log_rotation_type = none {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] max_age = 0 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] max_logfile_count = 30 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] max_logfile_size_mb = 200 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] max_over_subscription_ratio = 20.0 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] message_reap_interval = 86400 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] message_ttl = 2592000 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] migration_create_volume_timeout_secs = 300 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] monkey_patch = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] monkey_patch_modules = [] {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] my_ip = 192.168.122.209 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] no_snapshot_gb_quota = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] num_iser_scan_tries = 3 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] num_shell_tries = 3 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] num_volume_device_scan_tries = 3 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] nvmeof_conn_info_version = 1 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] nvmet_ns_id = 10 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] nvmet_port_id = 1 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] osapi_max_limit = 1000 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] osapi_volume_ext_list = [] {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] osapi_volume_listen_port = 8776 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] osapi_volume_use_ssl = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] osapi_volume_workers = 2 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] per_volume_size_limit = -1 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] periodic_fuzzy_delay = 60 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] periodic_interval = 60 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] public_endpoint = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] publish_errors = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] quota_backup_gigabytes = 1000 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] quota_backups = 10 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] quota_gigabytes = 1000 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] quota_groups = 10 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] quota_snapshots = 10 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] quota_volumes = 10 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] rate_limit_burst = 0 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] rate_limit_except_level = CRITICAL {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] rate_limit_interval = 0 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] reinit_driver_count = 3 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] replication_device = **** {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] report_discard_supported = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] report_interval = 120 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] reservation_clean_interval = 86400 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] reservation_expire = 86400 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] reserved_image_namespaces = [] {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] reserved_percentage = 0 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] rpc_response_timeout = 120 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] run_external_periodic_tasks = True {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] scst_target_driver = iscsi {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] scst_target_iqn_name = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] service_down_time = 720 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] shell_completion = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] snapshot_name_template = snapshot-%s {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] snapshot_same_host = True {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] split_loggers = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] state_path = /opt/stack/data/cinder {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] storage_availability_zone = nova {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] storage_protocol = iSCSI {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] syslog_log_facility = LOG_USER {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] target_helper = lioadm {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] target_ip_address = 192.168.122.209 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] target_port = 3260 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] target_protocol = iscsi {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] target_secondary_ip_addresses = [] {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] trace_flags = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] transport_url = **** {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] until_refresh = 0 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] use_chap_auth = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] use_default_quota_class = True {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] use_journal = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] use_json = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] use_multipath_for_image_xfer = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] use_stderr = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] use_syslog = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] verify_glance_signatures = enabled {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] volume_api_class = cinder.volume.api.API {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] volume_backend_name = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] volume_clear = zero {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] volume_clear_ionice = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] volume_clear_size = 0 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] volume_copy_bps_limit = 0 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] volume_dd_blocksize = 1M {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] volume_name_template = volume-%s {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] volume_service_inithost_offload = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] volume_usage_audit_period = month {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] zoning_mode = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_concurrency.disable_process_locking = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.admin_password = **** {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.admin_token = **** {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.admin_user = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.auth_admin_prefix = {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.auth_port = 35357 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.auth_protocol = https {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.auth_section = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.auth_type = password {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.auth_uri = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.auth_version = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.cache = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.certfile = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.identity_uri = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.include_service_catalog = True {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.insecure = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.interface = public {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.keyfile = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.memcache_password = {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.memcache_username = {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.region_name = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.service_type = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.209/identity {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.backend = dogpile.cache.null {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.backend_argument = **** {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.backend_expiration_time = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.config_prefix = cache.oslo {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.debug_cache_backend = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.enable_retry_client = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.enable_socket_keepalive = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.enabled = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.enforce_fips_mode = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.expiration_time = 600 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.hashclient_retry_attempts = 2 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.memcache_dead_retry = 300 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.memcache_pool_maxsize = 10 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.memcache_sasl_enabled = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.password = **** {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.proxies = [] {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.redis_db = 0 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.redis_server = localhost:6379 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.retry_attempts = 2 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.retry_delay = 0.0 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.socket_keepalive_count = 1 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.socket_keepalive_idle = 1 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.socket_keepalive_interval = 1 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.socket_timeout = 1.0 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.tls_allowed_ciphers = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.tls_cafile = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.tls_certfile = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.tls_enabled = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.tls_keyfile = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cache.username = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] database.asyncio_connection = **** {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] database.asyncio_slave_connection = **** {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] database.backend = sqlalchemy {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] database.connection = **** {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] database.connection_debug = 0 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] database.connection_parameters = {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] database.connection_recycle_time = 3600 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] database.connection_trace = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] database.db_inc_retry_interval = True {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] database.db_max_retries = 20 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] database.db_max_retry_interval = 10 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] database.db_retry_interval = 1 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] database.max_overflow = 50 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] database.max_pool_size = 5 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] database.max_retries = 10 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] database.mysql_wsrep_sync_wait = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] database.pool_timeout = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] database.retry_interval = 10 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] database.slave_connection = **** {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] database.sqlite_synchronous = True {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] database.synchronous_reader = True {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] database.use_db_reconnect = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] profiler.connection_string = messaging:// {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] profiler.enabled = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] profiler.es_doc_type = notification {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] profiler.es_scroll_size = 10000 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] profiler.es_scroll_time = 2m {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] profiler.filter_error_trace = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] profiler.hmac_keys = **** {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] profiler.sentinel_service_name = mymaster {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75602]: INFO cinder.volume.manager [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] profiler.socket_timeout = 0.1 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] profiler.trace_requests = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] profiler.trace_sqlalchemy = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] profiler_jaeger.process_tags = {} {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] profiler_jaeger.service_name_prefix = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] profiler_otlp.service_name_prefix = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_policy.enforce_new_defaults = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: WARNING oslo_config.cfg [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_policy.enforce_scope = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_policy.policy_default_rule = default {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_policy.policy_file = policy.yaml {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] coordination.backend_url = **** {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] privsep_osbrick.group = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] privsep_osbrick.helper_command = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] privsep_osbrick.user = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cinder_sys_admin.group = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cinder_sys_admin.helper_command = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] cinder_sys_admin.user = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] service_user.auth_section = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] service_user.auth_type = password {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] service_user.cafile = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] service_user.certfile = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] service_user.collect_timing = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] service_user.insecure = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] service_user.keyfile = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] service_user.send_service_user_token = True {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] service_user.split_loggers = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] service_user.timeout = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] glance.auth_section = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] glance.auth_type = password {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] glance.certfile = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] glance.collect_timing = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] glance.insecure = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] glance.keyfile = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] glance.region_name = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] glance.split_loggers = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] glance.timeout = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.backend_availability_zone = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.chap_password = **** {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.chap_username = {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.disk_geometry = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.driver_client_cert = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.driver_client_cert_key = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.driver_data_namespace = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.driver_use_ssl = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.extra_capabilities = {} {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.filter_function = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.goodness_function = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.iscsi_target_flags = {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.iscsi_write_cache = on {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.iser_helper = tgtadm {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.iser_ip_address = 192.168.122.209 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.iser_port = 3260 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.lvm_share_target = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.lvm_type = auto {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.num_shell_tries = 3 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.replication_device = **** {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.report_discard_supported = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.reserved_percentage = 0 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.target_helper = tgtadm {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.target_ip_address = 192.168.122.209 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.target_port = 3260 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.target_protocol = iscsi {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.trace_flags = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.unique_fqdn_network = True {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.use_chap_auth = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.volume_backend_name = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.volume_clear = zero {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.volume_clear_ionice = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.volume_clear_size = 0 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_reports.file_event_handler = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_reports.log_dir = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.backend_host = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.chap_password = **** {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.chap_username = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.disk_geometry = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.driver_client_cert = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.extra_capabilities = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.filter_function = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.goodness_function = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.iser_helper = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.iser_ip_address = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.iser_port = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.lvm_share_target = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.lvm_type = auto {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.num_shell_tries = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.replication_device = **** {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.report_discard_supported = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.reserved_percentage = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.scst_target_driver = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.storage_protocol = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.target_helper = lioadm {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.target_ip_address = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.target_port = 3260 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.trace_flags = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.use_chap_auth = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.volume_clear = zero {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.volume_clear_size = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] lvmdriver-1.volumes_dir = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:19:06 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.ssl = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_notifications.driver = [] {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_notifications.retry = -1 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] key_manager.fixed_key = **** {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] barbican.barbican_api_version = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] barbican.barbican_endpoint = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] barbican.barbican_endpoint_type = public {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] barbican.barbican_region_name = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] barbican.cafile = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] barbican.certfile = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] barbican.collect_timing = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] barbican.insecure = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] barbican.keyfile = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] barbican.number_of_retries = 60 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] barbican.retry_delay = 1 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] barbican.send_service_user_token = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] barbican.split_loggers = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] barbican.timeout = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] barbican.verify_ssl = True {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack sudo[75606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] barbican.verify_ssl_path = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] barbican_service_user.auth_section = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack sudo[75606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] barbican_service_user.auth_type = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] barbican_service_user.cafile = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] barbican_service_user.certfile = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] barbican_service_user.collect_timing = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] barbican_service_user.insecure = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] barbican_service_user.keyfile = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] barbican_service_user.split_loggers = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] barbican_service_user.timeout = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] vault.approle_role_id = **** {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] vault.approle_secret_id = **** {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] vault.kv_mountpoint = secret {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] vault.kv_path = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] vault.kv_version = 2 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] vault.namespace = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] vault.root_token_id = **** {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] vault.ssl_ca_crt_file = None {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] vault.timeout = 60.0 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] vault.use_ssl = False {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:19:06 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] ******************************************************************************** {{(pid=75426) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 04 06:19:07 devstack sudo[75606]: pam_unix(sudo:session): session closed for user root Jun 04 06:19:07 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.816s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:19:07 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:19:07 devstack sudo[75698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 06:19:07 devstack sudo[75698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:19:07 devstack sudo[75698]: pam_unix(sudo:session): session closed for user root Jun 04 06:19:07 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.673s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:19:07 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:19:07 devstack cinder-volume[75602]: INFO cinder.brick.local_dev.lvm [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 04 06:19:07 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:19:07 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:19:07 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:19:07 devstack sudo[75918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 04 06:19:07 devstack sudo[75918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:19:08 devstack sudo[75918]: pam_unix(sudo:session): session closed for user root Jun 04 06:19:08 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.674s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:19:08 devstack cinder-volume[75602]: DEBUG cinder.brick.local_dev.lvm [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75602) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 04 06:19:08 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:19:08 devstack sudo[76162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 06:19:08 devstack sudo[76162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:19:09 devstack sudo[76162]: pam_unix(sudo:session): session closed for user root Jun 04 06:19:09 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.253s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:19:09 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:19:09 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:19:09 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:19:09 devstack sudo[76355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 06:19:09 devstack sudo[76355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:19:10 devstack sudo[76355]: pam_unix(sudo:session): session closed for user root Jun 04 06:19:10 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.658s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:19:10 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:19:10 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:19:10 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:19:10 devstack sudo[76387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 04 06:19:10 devstack sudo[76387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:19:11 devstack sudo[76387]: pam_unix(sudo:session): session closed for user root Jun 04 06:19:11 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.743s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:19:11 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:19:11 devstack sudo[76390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 04 06:19:11 devstack sudo[76390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:19:11 devstack sudo[76390]: pam_unix(sudo:session): session closed for user root Jun 04 06:19:11 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.680s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:19:11 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:19:11 devstack sudo[76396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 04 06:19:11 devstack sudo[76396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:19:12 devstack sudo[76396]: pam_unix(sudo:session): session closed for user root Jun 04 06:19:12 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.739s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:19:12 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:19:12 devstack sudo[76433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 06:19:12 devstack sudo[76433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:19:13 devstack sudo[76433]: pam_unix(sudo:session): session closed for user root Jun 04 06:19:13 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.816s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:19:13 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:19:13 devstack sudo[76441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 06:19:13 devstack sudo[76441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:19:14 devstack sudo[76441]: pam_unix(sudo:session): session closed for user root Jun 04 06:19:14 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.828s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:19:14 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:19:14 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.068s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:19:14 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:19:14 devstack sudo[76448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 06:19:14 devstack sudo[76448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:19:15 devstack sudo[76448]: pam_unix(sudo:session): session closed for user root Jun 04 06:19:15 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.059s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:19:15 devstack cinder-volume[75602]: INFO cinder.volume.drivers.lvm [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 04 06:19:15 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:19:15 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:19:15 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:19:15 devstack sudo[76551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 06:19:15 devstack sudo[76551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:19:16 devstack cinder-volume[75426]: DEBUG dbcounter [-] [75426] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:19:16 devstack sudo[76551]: pam_unix(sudo:session): session closed for user root Jun 04 06:19:16 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.662s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:19:16 devstack cinder-volume[75602]: DEBUG cinder.volume.drivers.lvm [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Updating volume stats {{(pid=75602) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 04 06:19:16 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:19:16 devstack sudo[76573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 04 06:19:16 devstack sudo[76573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:19:16 devstack sudo[76573]: pam_unix(sudo:session): session closed for user root Jun 04 06:19:16 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.700s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:19:16 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:19:16 devstack sudo[76717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 06:19:16 devstack sudo[76717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:19:17 devstack sudo[76717]: pam_unix(sudo:session): session closed for user root Jun 04 06:19:17 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.574s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:19:17 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:19:17 devstack sudo[76720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 06:19:17 devstack sudo[76720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:19:17 devstack sudo[76720]: pam_unix(sudo:session): session closed for user root Jun 04 06:19:17 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.555s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:19:17 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:19:17 devstack sudo[76723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 06:19:17 devstack sudo[76723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:19:18 devstack sudo[76723]: pam_unix(sudo:session): session closed for user root Jun 04 06:19:18 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.559s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:19:18 devstack cinder-volume[75602]: INFO cinder.volume.driver [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Driver hasn't implemented _init_vendor_properties() Jun 04 06:19:18 devstack cinder-volume[75602]: DEBUG cinder.volume.driver [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75602) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 04 06:19:18 devstack cinder-volume[75602]: DEBUG oslo_db.sqlalchemy.engines [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75602) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 06:19:18 devstack cinder-volume[75602]: DEBUG dbcounter [-] [75602] Writer thread running {{(pid=75602) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 04 06:19:18 devstack cinder-volume[75602]: DEBUG cinder.db.sqlalchemy.api [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Building query based on filter {{(pid=75602) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3944}} Jun 04 06:19:18 devstack cinder-volume[75602]: DEBUG cinder.image.image_utils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75602) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 04 06:19:18 devstack cinder-volume[75602]: INFO cinder.keymgr.migration [None req-46a84150-d7d8-4a76-8c65-8b897372c28b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 04 06:19:18 devstack cinder-volume[75602]: DEBUG cinder.volume.drivers.lvm [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Updating volume stats {{(pid=75602) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 04 06:19:18 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:19:18 devstack sudo[76727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 04 06:19:18 devstack sudo[76727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:19:19 devstack sudo[76727]: pam_unix(sudo:session): session closed for user root Jun 04 06:19:19 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.606s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:19:19 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:19:19 devstack sudo[76730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 06:19:19 devstack sudo[76730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:19:19 devstack sudo[76730]: pam_unix(sudo:session): session closed for user root Jun 04 06:19:19 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.597s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:19:19 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:19:19 devstack sudo[76736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 06:19:19 devstack sudo[76736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:19:20 devstack sudo[76736]: pam_unix(sudo:session): session closed for user root Jun 04 06:19:20 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.670s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:19:20 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:19:20 devstack sudo[76740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 06:19:20 devstack sudo[76740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:19:21 devstack sudo[76740]: pam_unix(sudo:session): session closed for user root Jun 04 06:19:21 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.683s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:19:21 devstack cinder-volume[75602]: DEBUG cinder.manager [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Notifying Schedulers of capabilities ... {{(pid=75602) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:19:21 devstack cinder-volume[75602]: INFO cinder.volume.manager [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Driver initialization completed successfully. Jun 04 06:19:21 devstack cinder-volume[75602]: INFO cinder.manager [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Initiating service 2 cleanup Jun 04 06:19:21 devstack cinder-volume[75602]: INFO cinder.manager [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Service 2 cleanup completed. Jun 04 06:19:21 devstack cinder-volume[75602]: DEBUG cinder.service [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Creating RPC server for service cinder-volume {{(pid=75602) start /opt/stack/cinder/cinder/service.py:231}} Jun 04 06:19:21 devstack cinder-volume[75602]: DEBUG cinder.service [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75602) start /opt/stack/cinder/cinder/service.py:237}} Jun 04 06:19:21 devstack cinder-volume[75602]: INFO cinder.volume.manager [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 04 06:19:21 devstack cinder-volume[75602]: DEBUG cinder.volume.drivers.lvm [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Updating volume stats {{(pid=75602) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 04 06:19:21 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:19:21 devstack sudo[76743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 04 06:19:21 devstack sudo[76743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:19:21 devstack sudo[76743]: pam_unix(sudo:session): session closed for user root Jun 04 06:19:21 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.619s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:19:21 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:19:21 devstack sudo[76748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 06:19:21 devstack sudo[76748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:19:22 devstack sudo[76748]: pam_unix(sudo:session): session closed for user root Jun 04 06:19:22 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.667s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:19:22 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:19:22 devstack sudo[76751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 06:19:22 devstack sudo[76751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:19:23 devstack sudo[76751]: pam_unix(sudo:session): session closed for user root Jun 04 06:19:23 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.586s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:19:23 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:19:23 devstack sudo[76811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 06:19:23 devstack sudo[76811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:19:23 devstack sudo[76811]: pam_unix(sudo:session): session closed for user root Jun 04 06:19:23 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.572s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:19:23 devstack cinder-volume[75602]: INFO cinder.volume.manager [None req-7ac6f50f-645b-43c7-ab16-325292b99862 None None] Driver post RPC initialization completed successfully. Jun 04 06:19:33 devstack cinder-volume[75602]: DEBUG dbcounter [-] [75602] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75602) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:19:33 devstack cinder-volume[75602]: DEBUG dbcounter [-] [75602] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75602) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:19:44 devstack cinder-volume[75602]: DEBUG oslo_service.periodic_task [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] Running periodic task VolumeManager._thread_info {{(pid=75602) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:19:44 devstack cinder-volume[75602]: DEBUG cinder.volume.manager [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] thread count: 6 {{(pid=75602) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 06:19:44 devstack cinder-volume[75602]: DEBUG cinder.volume.manager [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] thread info: [<_MainThread(MainThread, started 132955060588672)>, , , , , ] {{(pid=75602) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 06:20:44 devstack cinder-volume[75602]: DEBUG oslo_service.periodic_task [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75602) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:20:44 devstack cinder-volume[75602]: DEBUG cinder.volume.drivers.lvm [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] Updating volume stats {{(pid=75602) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 04 06:20:44 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:20:44 devstack sudo[81489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 04 06:20:44 devstack sudo[81489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:20:45 devstack sudo[81489]: pam_unix(sudo:session): session closed for user root Jun 04 06:20:45 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.630s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:20:45 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:20:45 devstack sudo[81493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 06:20:45 devstack sudo[81493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:20:45 devstack sudo[81493]: pam_unix(sudo:session): session closed for user root Jun 04 06:20:45 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.575s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:20:45 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:20:45 devstack sudo[81497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 06:20:45 devstack sudo[81497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:20:46 devstack sudo[81497]: pam_unix(sudo:session): session closed for user root Jun 04 06:20:46 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.557s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:20:46 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:20:46 devstack sudo[81500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 06:20:46 devstack sudo[81500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:20:47 devstack sudo[81500]: pam_unix(sudo:session): session closed for user root Jun 04 06:20:47 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.568s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:20:47 devstack cinder-volume[75602]: DEBUG cinder.manager [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] Notifying Schedulers of capabilities ... {{(pid=75602) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:20:47 devstack cinder-volume[75602]: DEBUG oslo_service.periodic_task [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] Running periodic task VolumeManager._thread_info {{(pid=75602) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:20:47 devstack cinder-volume[75602]: DEBUG cinder.volume.manager [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] thread count: 6 {{(pid=75602) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 06:20:47 devstack cinder-volume[75602]: DEBUG cinder.volume.manager [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] thread info: [<_MainThread(MainThread, started 132955060588672)>, , , , , ] {{(pid=75602) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 06:21:33 devstack cinder-volume[75602]: DEBUG dbcounter [-] [75602] Writing DB stats cinder:SELECT=1 {{(pid=75602) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:21:33 devstack cinder-volume[75602]: DEBUG dbcounter [-] [75602] Writing DB stats cinder:UPDATE=1 {{(pid=75602) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:21:44 devstack cinder-volume[75602]: DEBUG oslo_service.periodic_task [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75602) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:21:44 devstack cinder-volume[75602]: DEBUG cinder.volume.drivers.lvm [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] Updating volume stats {{(pid=75602) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 04 06:21:44 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:21:44 devstack sudo[81948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 04 06:21:44 devstack sudo[81948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:21:45 devstack sudo[81948]: pam_unix(sudo:session): session closed for user root Jun 04 06:21:45 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.587s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:21:45 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:21:45 devstack sudo[81951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 06:21:45 devstack sudo[81951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:21:45 devstack sudo[81951]: pam_unix(sudo:session): session closed for user root Jun 04 06:21:45 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.579s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:21:45 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:21:45 devstack sudo[81956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 06:21:45 devstack sudo[81956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:21:46 devstack sudo[81956]: pam_unix(sudo:session): session closed for user root Jun 04 06:21:46 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.617s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:21:46 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:21:46 devstack sudo[81959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 06:21:46 devstack sudo[81959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:21:47 devstack sudo[81959]: pam_unix(sudo:session): session closed for user root Jun 04 06:21:47 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.594s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:21:47 devstack cinder-volume[75602]: DEBUG cinder.manager [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] Notifying Schedulers of capabilities ... {{(pid=75602) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:21:47 devstack cinder-volume[75602]: DEBUG oslo_service.periodic_task [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] Running periodic task VolumeManager._thread_info {{(pid=75602) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:21:47 devstack cinder-volume[75602]: DEBUG cinder.volume.manager [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] thread count: 6 {{(pid=75602) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 06:21:47 devstack cinder-volume[75602]: DEBUG cinder.volume.manager [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] thread info: [<_MainThread(MainThread, started 132955060588672)>, , , , , ] {{(pid=75602) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 06:22:44 devstack cinder-volume[75602]: DEBUG oslo_service.periodic_task [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75602) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:22:44 devstack cinder-volume[75602]: DEBUG cinder.volume.drivers.lvm [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] Updating volume stats {{(pid=75602) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 04 06:22:44 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:22:44 devstack sudo[84213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 04 06:22:44 devstack sudo[84213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:22:45 devstack sudo[84213]: pam_unix(sudo:session): session closed for user root Jun 04 06:22:45 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.599s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:22:45 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:22:45 devstack sudo[84219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 06:22:45 devstack sudo[84219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:22:45 devstack sudo[84219]: pam_unix(sudo:session): session closed for user root Jun 04 06:22:45 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.615s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:22:45 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:22:45 devstack sudo[84228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 06:22:45 devstack sudo[84228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:22:46 devstack sudo[84228]: pam_unix(sudo:session): session closed for user root Jun 04 06:22:46 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.588s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:22:46 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:22:46 devstack sudo[84238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 06:22:46 devstack sudo[84238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:22:47 devstack sudo[84238]: pam_unix(sudo:session): session closed for user root Jun 04 06:22:47 devstack cinder-volume[75602]: DEBUG oslo_concurrency.processutils [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.577s {{(pid=75602) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:22:47 devstack cinder-volume[75602]: DEBUG cinder.manager [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] Notifying Schedulers of capabilities ... {{(pid=75602) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:22:47 devstack cinder-volume[75602]: DEBUG oslo_service.periodic_task [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] Running periodic task VolumeManager._thread_info {{(pid=75602) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:22:47 devstack cinder-volume[75602]: DEBUG cinder.volume.manager [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] thread count: 6 {{(pid=75602) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 06:22:47 devstack cinder-volume[75602]: DEBUG cinder.volume.manager [None req-50cce8eb-0218-40ec-b17f-4add81f1942d None None] thread info: [<_MainThread(MainThread, started 132955060588672)>, , , , , ] {{(pid=75602) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 06:23:33 devstack cinder-volume[75602]: DEBUG dbcounter [-] [75602] Writing DB stats cinder:SELECT=1 {{(pid=75602) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:23:33 devstack cinder-volume[75602]: DEBUG dbcounter [-] [75602] Writing DB stats cinder:UPDATE=1 {{(pid=75602) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:23:38 devstack cinder-volume[75426]: INFO oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] Caught SIGTERM, stopping children Jun 04 06:23:38 devstack cinder-volume[75426]: DEBUG oslo_concurrency.lockutils [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] Acquiring lock "singleton_lock" {{(pid=75426) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 04 06:23:38 devstack cinder-volume[75426]: DEBUG oslo_concurrency.lockutils [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] Acquired lock "singleton_lock" {{(pid=75426) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 04 06:23:38 devstack cinder-volume[75426]: DEBUG oslo_concurrency.lockutils [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] Releasing lock "singleton_lock" {{(pid=75426) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 04 06:23:38 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] Stop services. {{(pid=75426) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 04 06:23:38 devstack cinder-volume[75426]: DEBUG oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] Killing children. {{(pid=75426) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 04 06:23:38 devstack cinder-volume[75426]: INFO oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] Waiting on 1 children to exit Jun 04 06:23:41 devstack cinder-volume[75602]: DEBUG oslo_concurrency.lockutils [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] Acquiring lock "singleton_lock" {{(pid=75602) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 04 06:23:41 devstack cinder-volume[75602]: DEBUG oslo_concurrency.lockutils [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] Acquired lock "singleton_lock" {{(pid=75602) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 04 06:23:41 devstack cinder-volume[75602]: DEBUG oslo_concurrency.lockutils [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] Releasing lock "singleton_lock" {{(pid=75602) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 04 06:23:41 devstack cinder-volume[75602]: WARNING amqp [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 04 06:23:41 devstack cinder-volume[75602]: WARNING amqp [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 04 06:23:41 devstack cinder-volume[75426]: INFO oslo_service.backend._eventlet.service [None req-e1901343-c051-436d-87ae-fdbb258895b0 None None] Child 75602 exited with status 0 Jun 04 06:23:43 devstack cinder-volume[85307]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85307) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 04 06:23:43 devstack cinder-volume[85307]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85307) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 04 06:23:43 devstack cinder-volume[85307]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85307) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 04 06:23:44 devstack cinder-volume[85307]: INFO dbcounter [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] Registered counter for database cinder Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_db.sqlalchemy.engines [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85307) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG dbcounter [-] [85307] Writer thread running {{(pid=85307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 04 06:23:44 devstack cinder-volume[85307]: INFO cinder.rpc [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 04 06:23:44 devstack cinder-volume[85307]: INFO cinder.rpc [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_db.sqlalchemy.engines [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85307) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 06:23:44 devstack cinder-volume[85307]: INFO cinder.volume.manager [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] Determined volume DB was empty at startup. Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG cinder.volume.manager [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85307) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 04 06:23:44 devstack cinder-volume[85307]: INFO cinder.volume.manager [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 04 06:23:44 devstack cinder-volume[85307]: WARNING stevedore.named [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 04 06:23:44 devstack cinder-volume[85307]: WARNING castellan.key_manager [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 04 06:23:44 devstack cinder-volume[85307]: WARNING cinder.keymgr.conf_key_mgr [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 04 06:23:44 devstack cinder-volume[85307]: INFO cinder.volume.manager [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_db.sqlalchemy.engines [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85307) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 06:23:44 devstack cinder-volume[85307]: INFO oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] Starting 1 workers Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] Started child 85519 {{(pid=85307) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] Full set of CONF: {{(pid=85307) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] ******************************************************************************** {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] Configuration options gathered from: {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 04 06:23:44 devstack cinder-volume[85519]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] ================================================================================ {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] allow_availability_zone_fallback = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] allow_compression_on_image_upload = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] allowed_direct_url_schemes = [] {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] api_rate_limit = True {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] auth_strategy = keystone {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_availability_zone = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_host = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_name = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_stats_polling_interval = 60 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backup_api_class = cinder.backup.api.API {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backup_name_template = backup-%s {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backup_use_same_host = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backup_use_temp_snapshot = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] chap_password = **** {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] chap_username = {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cinder_internal_tenant_project_id = 2328755ba72947f0b99445636a345078 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cinder_internal_tenant_user_id = 94437284f3de45d58e340160525efc6c {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cluster = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] compression_format = gzip {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] compute_api_class = cinder.compute.nova.API {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] config_dir = [] {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] config_source = [] {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] control_exchange = openstack {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] debug = True {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] default_availability_zone = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] default_group_type = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] default_volume_type = QuobyteHD {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] disk_geometry = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85519]: INFO cinder.volume.manager [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] driver_client_cert = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] driver_client_cert_key = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85519]: DEBUG cinder.volume.drivers.remotefs [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85519) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] driver_data_namespace = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] driver_ssl_cert_path = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] driver_ssl_cert_verify = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] driver_use_ssl = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] enable_new_services = True {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] enable_unsupported_driver = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] enabled_backends = ['QuobyteHD'] {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] enforce_multipath_for_image_xfer = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] filter_function = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] glance_api_insecure = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] glance_api_servers = ['http://192.168.122.209/image'] {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] glance_api_ssl_compression = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] glance_ca_certificates_file = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] glance_catalog_info = image:glance:publicURL {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] glance_certfile = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] glance_keyfile = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] glance_num_retries = 3 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] glance_request_timeout = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] goodness_function = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] graceful_shutdown_timeout = 5 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] group_api_class = cinder.group.api.API {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] host = devstack {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] image_compress_on_upload = True {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] image_conversion_address_space_limit = 1 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] image_conversion_cpu_limit = 60 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] image_conversion_disable = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] image_upload_use_cinder_backend = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] image_upload_use_internal_tenant = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] image_volume_cache_enabled = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] image_volume_cache_max_count = 0 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] image_volume_cache_max_size_gb = 0 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] init_host_max_objects_retrieval = 0 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] instance_format = [instance: %(uuid)s] {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] iscsi_target_flags = {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] iscsi_write_cache = on {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] iser_helper = tgtadm {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] iser_ip_address = 192.168.122.209 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] iser_port = 3260 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] log_color = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] log_config_append = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] log_dir = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] log_file = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] log_options = True {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] log_rotate_interval = 1 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] log_rotate_interval_type = days {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] log_rotation_type = none {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] max_age = 0 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] max_logfile_count = 30 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] max_logfile_size_mb = 200 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] max_over_subscription_ratio = 20.0 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] message_reap_interval = 86400 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] message_ttl = 2592000 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] migration_create_volume_timeout_secs = 300 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] monkey_patch = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] monkey_patch_modules = [] {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] my_ip = 192.168.122.209 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] no_snapshot_gb_quota = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] num_iser_scan_tries = 3 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] num_shell_tries = 3 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] num_volume_device_scan_tries = 3 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] nvmeof_conn_info_version = 1 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:44 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] nvmet_ns_id = 10 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] nvmet_port_id = 1 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] osapi_max_limit = 1000 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] osapi_volume_ext_list = [] {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] osapi_volume_listen = 0.0.0.0 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] osapi_volume_listen_port = 8776 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] osapi_volume_use_ssl = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] osapi_volume_workers = 2 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] per_volume_size_limit = -1 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] periodic_fuzzy_delay = 60 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] periodic_interval = 60 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] project_id_regex = [0-9a-f\-]+ {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85519]: DEBUG cinder.volume.drivers.quobyte [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85519) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 04 06:23:45 devstack cinder-volume[85519]: WARNING cinder.volume.drivers.quobyte [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 04 06:23:45 devstack cinder-volume[85519]: WARNING cinder.volume.drivers.quobyte [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 04 06:23:45 devstack cinder-volume[85519]: DEBUG oslo_concurrency.processutils [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Running cmd (subprocess): mount.quobyte {{(pid=85519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] public_endpoint = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] publish_errors = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] quota_backup_gigabytes = 1000 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] quota_backups = 10 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] quota_gigabytes = 1000 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] quota_groups = 10 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] quota_snapshots = 10 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] quota_volumes = 10 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] rate_limit_burst = 0 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] rate_limit_except_level = CRITICAL {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] rate_limit_interval = 0 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] reinit_driver_count = 3 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] replication_device = **** {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] report_discard_supported = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] report_interval = 120 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] reservation_clean_interval = 86400 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] reservation_expire = 86400 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] reserved_image_namespaces = [] {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] reserved_percentage = 0 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] rpc_response_timeout = 120 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] run_external_periodic_tasks = True {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] scst_target_driver = iscsi {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] scst_target_iqn_name = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] service_down_time = 720 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] shell_completion = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] snapshot_name_template = snapshot-%s {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] split_loggers = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] state_path = /opt/stack/data/cinder {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] storage_availability_zone = nova {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] storage_protocol = iSCSI {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] syslog_log_facility = LOG_USER {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] target_helper = lioadm {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] target_ip_address = 192.168.122.209 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] target_port = 3260 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] target_protocol = iscsi {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] target_secondary_ip_addresses = [] {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] trace_flags = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] transfer_api_class = cinder.transfer.api.API {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] transport_url = **** {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] until_refresh = 0 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] use_chap_auth = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] use_default_quota_class = True {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] use_journal = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] use_json = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] use_multipath_for_image_xfer = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] use_stderr = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] use_syslog = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] verify_glance_signatures = enabled {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] volume_api_class = cinder.volume.api.API {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] volume_backend_name = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] volume_clear = zero {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] volume_clear_ionice = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] volume_clear_size = 0 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] volume_copy_bps_limit = 0 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] volume_dd_blocksize = 1M {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] volume_name_template = volume-%s {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] volume_service_inithost_offload = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] volume_usage_audit_period = month {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] zoning_mode = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_concurrency.disable_process_locking = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.admin_password = **** {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.admin_tenant_name = admin {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.admin_token = **** {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.admin_user = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.auth_admin_prefix = {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.auth_port = 35357 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.auth_protocol = https {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.auth_section = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.auth_type = password {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.auth_uri = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.auth_version = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.cache = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.certfile = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.delay_auth_decision = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.http_connect_timeout = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.identity_uri = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.include_service_catalog = True {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.insecure = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack quobyte-client[85520]: Reading configuration file: /etc/quobyte/client.cfg Jun 04 06:23:45 devstack quobyte-client[85520]: Invalid parameters found, error: missing mount point. Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.interface = public {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.keyfile = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack quobyte-client[85520]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.memcache_password = {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack quobyte-client[85520]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85519]: DEBUG oslo_concurrency.processutils [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] CMD "mount.quobyte" returned: 1 in 0.081s {{(pid=85519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:23:45 devstack cinder-volume[85519]: DEBUG oslo_concurrency.lockutils [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85519) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:23:45 devstack cinder-volume[85519]: DEBUG oslo_concurrency.lockutils [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85519) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:23:45 devstack cinder-volume[85519]: DEBUG cinder.volume.drivers.quobyte [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=85519) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:23:45 devstack cinder-volume[85519]: INFO cinder.volume.drivers.quobyte [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 ... Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85519]: DEBUG oslo_concurrency.processutils [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 -c /etc/quobyte/client-cinder.cfg {{(pid=85519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.memcache_username = {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.region_name = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.service_token_roles_required = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.service_type = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.token_cache_time = 300 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.209/identity {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.backend = dogpile.cache.null {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.backend_argument = **** {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.backend_expiration_time = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.config_prefix = cache.oslo {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.debug_cache_backend = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.enable_retry_client = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.enable_socket_keepalive = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.enabled = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.enforce_fips_mode = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.expiration_time = 600 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.hashclient_retry_attempts = 2 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.memcache_dead_retry = 300 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.memcache_pool_maxsize = 10 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack sudo[85521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 -c /etc/quobyte/client-cinder.cfg Jun 04 06:23:45 devstack sudo[85521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.memcache_sasl_enabled = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.password = **** {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.proxies = [] {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.redis_db = 0 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.redis_sentinel_service_name = mymaster {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.redis_server = localhost:6379 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.retry_attempts = 2 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.retry_delay = 0.0 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.socket_keepalive_count = 1 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.socket_keepalive_idle = 1 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.socket_keepalive_interval = 1 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.socket_timeout = 1.0 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.tls_allowed_ciphers = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.tls_cafile = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.tls_certfile = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.tls_enabled = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.tls_keyfile = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cache.username = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] database.asyncio_connection = **** {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] database.asyncio_slave_connection = **** {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] database.backend = sqlalchemy {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] database.connection = **** {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] database.connection_debug = 0 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] database.connection_parameters = {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] database.connection_recycle_time = 3600 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] database.connection_trace = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] database.db_inc_retry_interval = True {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] database.db_max_retries = 20 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] database.db_max_retry_interval = 10 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] database.db_retry_interval = 1 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] database.max_overflow = 50 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] database.max_pool_size = 5 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] database.max_retries = 10 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] database.mysql_wsrep_sync_wait = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] database.pool_timeout = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] database.retry_interval = 10 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] database.slave_connection = **** {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] database.sqlite_synchronous = True {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] database.synchronous_reader = True {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] database.use_db_reconnect = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] profiler.connection_string = messaging:// {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] profiler.enabled = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] profiler.es_doc_type = notification {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] profiler.es_scroll_size = 10000 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] profiler.es_scroll_time = 2m {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] profiler.filter_error_trace = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] profiler.hmac_keys = **** {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] profiler.sentinel_service_name = mymaster {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] profiler.socket_timeout = 0.1 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] profiler.trace_requests = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] profiler.trace_sqlalchemy = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] profiler_jaeger.process_tags = {} {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] profiler_jaeger.service_name_prefix = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] profiler_otlp.service_name_prefix = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_policy.enforce_new_defaults = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: WARNING oslo_config.cfg [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_policy.enforce_scope = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_policy.policy_default_rule = default {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_policy.policy_file = policy.yaml {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_policy.remote_timeout = 60.0 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] coordination.backend_url = **** {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] privsep_osbrick.group = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] privsep_osbrick.helper_command = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] privsep_osbrick.user = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cinder_sys_admin.group = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cinder_sys_admin.helper_command = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] cinder_sys_admin.user = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] service_user.auth_section = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] service_user.auth_type = password {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] service_user.cafile = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] service_user.certfile = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] service_user.collect_timing = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] service_user.insecure = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] service_user.keyfile = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] service_user.send_service_user_token = True {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] service_user.split_loggers = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] service_user.timeout = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] glance.auth_section = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] glance.auth_type = password {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] glance.certfile = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] glance.collect_timing = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] glance.insecure = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] glance.keyfile = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] glance.region_name = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] glance.split_loggers = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] glance.timeout = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.backend_availability_zone = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.chap_password = **** {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.chap_username = {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.disk_geometry = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.driver_client_cert = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.driver_client_cert_key = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.driver_data_namespace = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.driver_use_ssl = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.enable_unsupported_driver = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.extra_capabilities = {} {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.filter_function = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.goodness_function = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.iscsi_target_flags = {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.iscsi_write_cache = on {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.iser_helper = tgtadm {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.iser_ip_address = 192.168.122.209 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.iser_port = 3260 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.nas_host = {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.nas_login = admin {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.nas_mount_options = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.nas_password = **** {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.nas_private_key = {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.nas_share_path = {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.nas_ssh_port = 22 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.num_shell_tries = 3 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.nvmet_port_id = 1 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.quobyte_client_cfg = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.quobyte_volume_url = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.replication_device = **** {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.report_discard_supported = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.reserved_percentage = 0 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.scst_target_driver = iscsi {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.scst_target_iqn_name = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.storage_protocol = iSCSI {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.target_helper = tgtadm {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.target_ip_address = 192.168.122.209 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.target_port = 3260 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.target_protocol = iscsi {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.trace_flags = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.unique_fqdn_network = True {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.use_chap_auth = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.volume_backend_name = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.volume_clear = zero {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.volume_clear_ionice = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.volume_clear_size = 0 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_reports.file_event_handler = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_reports.log_dir = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.backend_availability_zone = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.backend_host = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.chap_password = **** {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.chap_username = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.chiscsi_conf = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.disk_geometry = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.driver_client_cert = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.driver_client_cert_key = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.driver_data_namespace = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.driver_use_ssl = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.extra_capabilities = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.filter_function = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.goodness_function = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.iscsi_target_flags = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.iscsi_write_cache = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.iser_helper = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.iser_ip_address = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.iser_port = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.iser_target_prefix = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.nas_host = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.nas_login = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.nas_mount_options = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.nas_password = **** {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.nas_private_key = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.nas_share_path = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.nas_ssh_port = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.num_shell_tries = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.nvmet_ns_id = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.nvmet_port_id = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.replication_device = **** {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.report_discard_supported = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.reserved_percentage = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.scst_target_driver = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.storage_protocol = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.target_helper = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.target_ip_address = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.target_port = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.target_prefix = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.target_protocol = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.trace_flags = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.unique_fqdn_network = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.use_chap_auth = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.volume_clear = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.volume_clear_ionice = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.volume_clear_size = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] QuobyteHD.volumes_dir = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.ssl = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.ssl_version = {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_notifications.driver = [] {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_notifications.retry = -1 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] oslo_messaging_notifications.transport_url = **** {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] key_manager.fixed_key = **** {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] barbican.barbican_api_version = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] barbican.barbican_endpoint = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] barbican.barbican_endpoint_type = public {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] barbican.barbican_region_name = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] barbican.cafile = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] barbican.certfile = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] barbican.collect_timing = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] barbican.insecure = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] barbican.keyfile = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] barbican.number_of_retries = 60 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] barbican.retry_delay = 1 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] barbican.send_service_user_token = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] barbican.split_loggers = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] barbican.timeout = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] barbican.verify_ssl = True {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] barbican.verify_ssl_path = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] barbican_service_user.auth_section = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] barbican_service_user.auth_type = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] barbican_service_user.cafile = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] barbican_service_user.certfile = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] barbican_service_user.collect_timing = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] barbican_service_user.insecure = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] barbican_service_user.keyfile = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] barbican_service_user.split_loggers = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] barbican_service_user.timeout = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] vault.approle_role_id = **** {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] vault.approle_secret_id = **** {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] vault.kv_mountpoint = secret {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] vault.kv_path = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] vault.kv_version = 2 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] vault.namespace = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] vault.root_token_id = **** {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] vault.ssl_ca_crt_file = None {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] vault.timeout = 60.0 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] vault.use_ssl = False {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:23:45 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] ******************************************************************************** {{(pid=85307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 04 06:23:45 devstack sudo[85521]: pam_unix(sudo:session): session closed for user root Jun 04 06:23:45 devstack cinder-volume[85519]: DEBUG oslo_concurrency.processutils [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.831s {{(pid=85519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:23:45 devstack cinder-volume[85519]: INFO cinder.volume.drivers.quobyte [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 succeeded Jun 04 06:23:45 devstack cinder-volume[85519]: DEBUG cinder.volume.drivers.quobyte [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=85519) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:23:45 devstack cinder-volume[85519]: DEBUG oslo_concurrency.lockutils [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.841s {{(pid=85519) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:23:45 devstack cinder-volume[85519]: DEBUG oslo_concurrency.processutils [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=85519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:23:45 devstack sudo[85595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:23:45 devstack sudo[85595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:23:46 devstack sudo[85595]: pam_unix(sudo:session): session closed for user root Jun 04 06:23:46 devstack cinder-volume[85519]: DEBUG oslo_concurrency.processutils [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.583s {{(pid=85519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:23:46 devstack cinder-volume[85519]: INFO cinder.volume.driver [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Driver hasn't implemented _init_vendor_properties() Jun 04 06:23:46 devstack cinder-volume[85519]: DEBUG cinder.volume.driver [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579765319824, 'free_capacity_gb': 1775.7579765319824, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85519) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 04 06:23:46 devstack cinder-volume[85519]: DEBUG oslo_db.sqlalchemy.engines [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85519) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 06:23:46 devstack cinder-volume[85519]: DEBUG dbcounter [-] [85519] Writer thread running {{(pid=85519) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 04 06:23:46 devstack cinder-volume[85519]: DEBUG cinder.db.sqlalchemy.api [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Building query based on filter {{(pid=85519) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3944}} Jun 04 06:23:46 devstack cinder-volume[85519]: DEBUG cinder.image.image_utils [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85519) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 04 06:23:46 devstack cinder-volume[85519]: INFO cinder.keymgr.migration [None req-8c7fae22-1d84-4088-967c-9537e2af9b09 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 04 06:23:46 devstack cinder-volume[85519]: DEBUG oslo_concurrency.lockutils [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85519) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:23:46 devstack cinder-volume[85519]: DEBUG oslo_concurrency.lockutils [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85519) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:23:46 devstack cinder-volume[85519]: DEBUG cinder.volume.drivers.quobyte [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=85519) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:23:46 devstack cinder-volume[85519]: DEBUG cinder.volume.drivers.quobyte [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=85519) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:23:46 devstack cinder-volume[85519]: DEBUG oslo_concurrency.lockutils [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85519) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:23:46 devstack cinder-volume[85519]: DEBUG oslo_concurrency.processutils [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=85519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:23:46 devstack sudo[85599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:23:46 devstack sudo[85599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:23:47 devstack sudo[85599]: pam_unix(sudo:session): session closed for user root Jun 04 06:23:47 devstack cinder-volume[85519]: DEBUG oslo_concurrency.processutils [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.600s {{(pid=85519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:23:47 devstack cinder-volume[85519]: DEBUG cinder.manager [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Notifying Schedulers of capabilities ... {{(pid=85519) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:23:47 devstack cinder-volume[85519]: INFO cinder.volume.manager [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Driver initialization completed successfully. Jun 04 06:23:47 devstack cinder-volume[85519]: INFO cinder.manager [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Initiating service 3 cleanup Jun 04 06:23:47 devstack cinder-volume[85519]: INFO cinder.manager [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Service 3 cleanup completed. Jun 04 06:23:47 devstack cinder-volume[85519]: DEBUG cinder.service [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Creating RPC server for service cinder-volume {{(pid=85519) start /opt/stack/cinder/cinder/service.py:231}} Jun 04 06:23:47 devstack cinder-volume[85519]: DEBUG cinder.service [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85519) start /opt/stack/cinder/cinder/service.py:237}} Jun 04 06:23:47 devstack cinder-volume[85519]: INFO cinder.volume.manager [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 04 06:23:47 devstack cinder-volume[85519]: DEBUG oslo_concurrency.lockutils [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85519) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:23:47 devstack cinder-volume[85519]: DEBUG oslo_concurrency.lockutils [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85519) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:23:47 devstack cinder-volume[85519]: DEBUG cinder.volume.drivers.quobyte [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=85519) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:23:47 devstack cinder-volume[85519]: DEBUG cinder.volume.drivers.quobyte [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=85519) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:23:47 devstack cinder-volume[85519]: DEBUG oslo_concurrency.lockutils [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85519) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:23:47 devstack cinder-volume[85519]: DEBUG oslo_concurrency.processutils [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=85519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:23:47 devstack sudo[85604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:23:47 devstack sudo[85604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:23:48 devstack sudo[85604]: pam_unix(sudo:session): session closed for user root Jun 04 06:23:48 devstack cinder-volume[85519]: DEBUG oslo_concurrency.processutils [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.637s {{(pid=85519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:23:48 devstack cinder-volume[85519]: INFO cinder.volume.manager [None req-06956e94-e7c3-416c-8ff9-cd8fb970e527 None None] Driver post RPC initialization completed successfully. Jun 04 06:23:52 devstack cinder-volume[85519]: DEBUG oslo_concurrency.lockutils [None req-4de02339-04b9-4d03-bfe7-12443d927ed4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85519) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:23:52 devstack cinder-volume[85519]: DEBUG oslo_concurrency.lockutils [None req-4de02339-04b9-4d03-bfe7-12443d927ed4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85519) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:23:52 devstack cinder-volume[85519]: DEBUG cinder.volume.drivers.quobyte [None req-4de02339-04b9-4d03-bfe7-12443d927ed4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=85519) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:23:52 devstack cinder-volume[85519]: DEBUG cinder.volume.drivers.quobyte [None req-4de02339-04b9-4d03-bfe7-12443d927ed4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=85519) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:23:52 devstack cinder-volume[85519]: DEBUG oslo_concurrency.lockutils [None req-4de02339-04b9-4d03-bfe7-12443d927ed4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85519) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:23:52 devstack cinder-volume[85519]: DEBUG oslo_concurrency.processutils [None req-4de02339-04b9-4d03-bfe7-12443d927ed4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=85519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:23:52 devstack sudo[85722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:23:52 devstack sudo[85722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:23:52 devstack sudo[85722]: pam_unix(sudo:session): session closed for user root Jun 04 06:23:52 devstack cinder-volume[85519]: DEBUG oslo_concurrency.processutils [None req-4de02339-04b9-4d03-bfe7-12443d927ed4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.574s {{(pid=85519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:23:52 devstack cinder-volume[85519]: DEBUG cinder.manager [None req-4de02339-04b9-4d03-bfe7-12443d927ed4 None None] Notifying Schedulers of capabilities ... {{(pid=85519) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:23:53 devstack cinder-volume[85307]: INFO oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] Caught SIGTERM, stopping children Jun 04 06:23:53 devstack cinder-volume[85307]: DEBUG oslo_concurrency.lockutils [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] Acquiring lock "singleton_lock" {{(pid=85307) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 04 06:23:53 devstack cinder-volume[85307]: DEBUG oslo_concurrency.lockutils [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] Acquired lock "singleton_lock" {{(pid=85307) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 04 06:23:53 devstack cinder-volume[85307]: DEBUG oslo_concurrency.lockutils [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] Releasing lock "singleton_lock" {{(pid=85307) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 04 06:23:53 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] Stop services. {{(pid=85307) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 04 06:23:53 devstack cinder-volume[85307]: DEBUG oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] Killing children. {{(pid=85307) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 04 06:23:53 devstack cinder-volume[85307]: INFO oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] Waiting on 1 children to exit Jun 04 06:23:55 devstack cinder-volume[85519]: DEBUG oslo_concurrency.lockutils [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] Acquiring lock "singleton_lock" {{(pid=85519) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 04 06:23:55 devstack cinder-volume[85519]: DEBUG oslo_concurrency.lockutils [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] Acquired lock "singleton_lock" {{(pid=85519) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 04 06:23:55 devstack cinder-volume[85519]: DEBUG oslo_concurrency.lockutils [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] Releasing lock "singleton_lock" {{(pid=85519) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 04 06:23:55 devstack cinder-volume[85519]: WARNING amqp [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 04 06:23:55 devstack cinder-volume[85519]: WARNING amqp [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 04 06:23:55 devstack cinder-volume[85307]: INFO oslo_service.backend._eventlet.service [None req-3a89b7e6-ef69-406d-b156-0f7c76c35d9a None None] Child 85519 exited with status 0 Jun 04 06:23:59 devstack cinder-volume[85799]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85799) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 04 06:23:59 devstack cinder-volume[85799]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85799) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 04 06:23:59 devstack cinder-volume[85799]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85799) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 04 06:24:00 devstack cinder-volume[85799]: INFO dbcounter [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] Registered counter for database cinder Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_db.sqlalchemy.engines [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85799) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG dbcounter [-] [85799] Writer thread running {{(pid=85799) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 04 06:24:00 devstack cinder-volume[85799]: INFO cinder.rpc [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 04 06:24:00 devstack cinder-volume[85799]: INFO cinder.rpc [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_db.sqlalchemy.engines [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85799) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 06:24:00 devstack cinder-volume[85799]: INFO cinder.volume.manager [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] Determined volume DB was empty at startup. Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG cinder.volume.manager [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85799) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 04 06:24:00 devstack cinder-volume[85799]: WARNING stevedore.named [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 04 06:24:00 devstack cinder-volume[85799]: WARNING castellan.key_manager [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 04 06:24:00 devstack cinder-volume[85799]: WARNING cinder.keymgr.conf_key_mgr [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 04 06:24:00 devstack cinder-volume[85799]: INFO cinder.volume.manager [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_db.sqlalchemy.engines [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85799) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 06:24:00 devstack cinder-volume[85799]: INFO oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] Starting 1 workers Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] Started child 86069 {{(pid=85799) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] Full set of CONF: {{(pid=85799) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] ******************************************************************************** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] Configuration options gathered from: {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] ================================================================================ {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] allow_availability_zone_fallback = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] allow_compression_on_image_upload = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[86069]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] allowed_direct_url_schemes = [] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] api_rate_limit = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] auth_strategy = keystone {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_availability_zone = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_host = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_name = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_stats_polling_interval = 60 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backup_api_class = cinder.backup.api.API {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backup_name_template = backup-%s {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backup_use_same_host = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backup_use_temp_snapshot = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] chap_password = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] chap_username = {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cinder_internal_tenant_project_id = 2328755ba72947f0b99445636a345078 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cinder_internal_tenant_user_id = 94437284f3de45d58e340160525efc6c {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cluster = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] compression_format = gzip {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] compute_api_class = cinder.compute.nova.API {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] config_dir = [] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] config_source = [] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] control_exchange = openstack {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] debug = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] default_availability_zone = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] default_group_type = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] default_volume_type = QuobyteHD {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] disk_geometry = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] driver_client_cert = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] driver_client_cert_key = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] driver_data_namespace = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] driver_ssl_cert_path = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] driver_ssl_cert_verify = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] driver_use_ssl = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] enable_new_services = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] enable_unsupported_driver = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] enabled_backends = ['QuobyteHD'] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] enforce_multipath_for_image_xfer = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] filter_function = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] glance_api_insecure = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] glance_api_servers = ['http://192.168.122.209/image'] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] glance_api_ssl_compression = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] glance_ca_certificates_file = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] glance_catalog_info = image:glance:publicURL {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] glance_certfile = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] glance_keyfile = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] glance_num_retries = 3 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] glance_request_timeout = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] goodness_function = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] graceful_shutdown_timeout = 5 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] group_api_class = cinder.group.api.API {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] host = devstack {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] image_compress_on_upload = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] image_conversion_address_space_limit = 1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] image_conversion_cpu_limit = 60 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] image_conversion_disable = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] image_upload_use_cinder_backend = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] image_upload_use_internal_tenant = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] image_volume_cache_enabled = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] image_volume_cache_max_count = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] image_volume_cache_max_size_gb = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] init_host_max_objects_retrieval = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] instance_format = [instance: %(uuid)s] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] iscsi_target_flags = {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] iscsi_write_cache = on {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] iser_helper = tgtadm {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] iser_ip_address = 192.168.122.209 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] iser_port = 3260 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] log_color = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] log_config_append = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] log_dir = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] log_file = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] log_options = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] log_rotate_interval = 1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] log_rotate_interval_type = days {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] log_rotation_type = none {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] max_age = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] max_logfile_count = 30 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] max_logfile_size_mb = 200 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] max_over_subscription_ratio = 20.0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] message_reap_interval = 86400 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] message_ttl = 2592000 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] migration_create_volume_timeout_secs = 300 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] monkey_patch = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] monkey_patch_modules = [] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] my_ip = 192.168.122.209 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] no_snapshot_gb_quota = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] num_iser_scan_tries = 3 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] num_shell_tries = 3 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] num_volume_device_scan_tries = 3 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] nvmeof_conn_info_version = 1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] nvmet_ns_id = 10 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] Starting volume driver QuobyteDriver (1.1.14) Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] nvmet_port_id = 1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86069) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] osapi_max_limit = 1000 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] osapi_volume_ext_list = [] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] osapi_volume_listen_port = 8776 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] osapi_volume_use_ssl = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] osapi_volume_workers = 2 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] per_volume_size_limit = -1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] periodic_fuzzy_delay = 60 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] periodic_interval = 60 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] public_endpoint = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] publish_errors = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] quota_backup_gigabytes = 1000 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] quota_backups = 10 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] quota_gigabytes = 1000 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] quota_groups = 10 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] quota_snapshots = 10 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] quota_volumes = 10 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] rate_limit_burst = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] rate_limit_except_level = CRITICAL {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] rate_limit_interval = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] reinit_driver_count = 3 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] replication_device = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] report_discard_supported = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] report_interval = 120 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] reservation_clean_interval = 86400 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] reservation_expire = 86400 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] reserved_image_namespaces = [] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] reserved_percentage = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] rpc_response_timeout = 120 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] run_external_periodic_tasks = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] scst_target_driver = iscsi {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] scst_target_iqn_name = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] service_down_time = 720 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] shell_completion = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] snapshot_name_template = snapshot-%s {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] split_loggers = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] state_path = /opt/stack/data/cinder {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] storage_availability_zone = nova {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] storage_protocol = iSCSI {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] syslog_log_facility = LOG_USER {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] target_helper = lioadm {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] target_ip_address = 192.168.122.209 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] target_port = 3260 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] target_protocol = iscsi {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] target_secondary_ip_addresses = [] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] trace_flags = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] transport_url = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] until_refresh = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] use_chap_auth = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] use_default_quota_class = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] use_journal = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] use_json = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] use_multipath_for_image_xfer = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] use_stderr = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] use_syslog = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] verify_glance_signatures = enabled {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] volume_api_class = cinder.volume.api.API {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] volume_backend_name = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] volume_clear = zero {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] volume_clear_ionice = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] volume_clear_size = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] volume_copy_bps_limit = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] volume_dd_blocksize = 1M {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] volume_name_template = volume-%s {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] volume_service_inithost_offload = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] volume_usage_audit_period = month {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] zoning_mode = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_concurrency.disable_process_locking = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.admin_password = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.admin_token = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.admin_user = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.auth_admin_prefix = {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.auth_port = 35357 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.auth_protocol = https {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.auth_section = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.auth_type = password {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.auth_uri = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.auth_version = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.cache = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.certfile = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.identity_uri = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.include_service_catalog = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.insecure = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.interface = public {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.keyfile = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.memcache_password = {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.memcache_username = {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.region_name = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.service_token_roles_required = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.service_type = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.209/identity {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.backend = dogpile.cache.null {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.backend_argument = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.backend_expiration_time = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.config_prefix = cache.oslo {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.debug_cache_backend = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.enable_retry_client = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.enable_socket_keepalive = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.enabled = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.enforce_fips_mode = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.expiration_time = 600 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.hashclient_retry_attempts = 2 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.memcache_dead_retry = 300 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.memcache_pool_maxsize = 10 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.memcache_sasl_enabled = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.password = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.proxies = [] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.redis_db = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.redis_server = localhost:6379 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.retry_attempts = 2 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.retry_delay = 0.0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.socket_keepalive_count = 1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.socket_keepalive_idle = 1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.socket_keepalive_interval = 1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.socket_timeout = 1.0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.tls_allowed_ciphers = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.tls_cafile = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.tls_certfile = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.tls_enabled = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.tls_keyfile = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cache.username = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] database.asyncio_connection = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] database.asyncio_slave_connection = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] database.backend = sqlalchemy {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] database.connection = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] database.connection_debug = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] database.connection_parameters = {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] database.connection_recycle_time = 3600 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] database.connection_trace = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] database.db_inc_retry_interval = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] database.db_max_retries = 20 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] database.db_max_retry_interval = 10 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] database.db_retry_interval = 1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] database.max_overflow = 50 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] database.max_pool_size = 5 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] database.max_retries = 10 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] database.mysql_wsrep_sync_wait = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86069) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 04 06:24:00 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.quobyte [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 04 06:24:00 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.quobyte [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] database.pool_timeout = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] database.retry_interval = 10 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] database.slave_connection = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] database.sqlite_synchronous = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] Running cmd (subprocess): mount.quobyte {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] database.synchronous_reader = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] database.use_db_reconnect = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] profiler.connection_string = messaging:// {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] profiler.enabled = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] profiler.es_doc_type = notification {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] profiler.es_scroll_size = 10000 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] profiler.es_scroll_time = 2m {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] profiler.filter_error_trace = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] profiler.hmac_keys = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] profiler.sentinel_service_name = mymaster {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] profiler.socket_timeout = 0.1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] profiler.trace_requests = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] profiler.trace_sqlalchemy = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] profiler_jaeger.process_tags = {} {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] profiler_jaeger.service_name_prefix = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] profiler_otlp.service_name_prefix = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_policy.enforce_new_defaults = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: WARNING oslo_config.cfg [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_policy.enforce_scope = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_policy.policy_default_rule = default {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_policy.policy_file = policy.yaml {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] coordination.backend_url = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] privsep_osbrick.group = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] privsep_osbrick.helper_command = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] privsep_osbrick.user = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cinder_sys_admin.group = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cinder_sys_admin.helper_command = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] cinder_sys_admin.user = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] service_user.auth_section = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] service_user.auth_type = password {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] service_user.cafile = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] service_user.certfile = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] service_user.collect_timing = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] service_user.insecure = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] service_user.keyfile = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] service_user.send_service_user_token = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] service_user.split_loggers = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] service_user.timeout = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] glance.auth_section = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] glance.auth_type = password {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] glance.certfile = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] glance.collect_timing = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] glance.insecure = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] glance.keyfile = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] glance.region_name = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] glance.split_loggers = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] glance.timeout = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.backend_availability_zone = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.chap_password = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.chap_username = {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.disk_geometry = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.driver_client_cert = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.driver_client_cert_key = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.driver_data_namespace = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.driver_use_ssl = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.extra_capabilities = {} {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.filter_function = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.goodness_function = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.iscsi_target_flags = {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.iscsi_write_cache = on {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.iser_helper = tgtadm {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.iser_ip_address = 192.168.122.209 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.iser_port = 3260 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.nas_host = {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.nas_login = admin {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.nas_mount_options = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.nas_password = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.nas_private_key = {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.nas_share_path = {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.num_shell_tries = 3 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.quobyte_volume_url = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.replication_device = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.report_discard_supported = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.reserved_percentage = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.target_helper = tgtadm {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.target_ip_address = 192.168.122.209 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.target_port = 3260 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.target_protocol = iscsi {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.trace_flags = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.unique_fqdn_network = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.use_chap_auth = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.volume_backend_name = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.volume_clear = zero {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.volume_clear_ionice = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.volume_clear_size = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_reports.file_event_handler = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_reports.log_dir = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.backend_availability_zone = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.backend_host = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.chap_password = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.chap_username = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.chiscsi_conf = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.disk_geometry = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.driver_client_cert = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.driver_data_namespace = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.driver_use_ssl = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.extra_capabilities = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.filter_function = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.goodness_function = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.iser_helper = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.iser_ip_address = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.iser_port = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.iser_target_prefix = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.nas_host = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.nas_login = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.nas_mount_options = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.nas_password = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.nas_private_key = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.nas_share_path = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.nas_ssh_port = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.num_shell_tries = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.nvmet_port_id = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.replication_device = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.report_discard_supported = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.reserved_percentage = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.scst_target_driver = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.storage_protocol = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.target_helper = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.target_ip_address = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.target_port = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.target_prefix = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.target_protocol = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.trace_flags = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.use_chap_auth = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.volume_clear = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.volume_clear_size = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] QuobyteHD.volumes_dir = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.ssl = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_notifications.driver = [] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_notifications.retry = -1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] key_manager.fixed_key = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] barbican.barbican_api_version = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] barbican.barbican_endpoint = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] barbican.barbican_endpoint_type = public {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] barbican.barbican_region_name = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] barbican.cafile = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] barbican.certfile = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] barbican.collect_timing = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack quobyte-client[86070]: Reading configuration file: /etc/quobyte/client.cfg Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] barbican.insecure = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] barbican.keyfile = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] barbican.number_of_retries = 60 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] barbican.retry_delay = 1 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] barbican.send_service_user_token = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] barbican.split_loggers = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] barbican.timeout = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack quobyte-client[86070]: Invalid parameters found, error: missing mount point. Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] barbican.verify_ssl = True {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] barbican.verify_ssl_path = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] barbican_service_user.auth_section = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] barbican_service_user.auth_type = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] barbican_service_user.cafile = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] barbican_service_user.certfile = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] barbican_service_user.collect_timing = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack quobyte-client[86070]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] barbican_service_user.insecure = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] barbican_service_user.keyfile = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] barbican_service_user.split_loggers = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] barbican_service_user.timeout = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] vault.approle_role_id = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] vault.approle_secret_id = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] vault.kv_mountpoint = secret {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack quobyte-client[86070]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] vault.kv_path = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] vault.kv_version = 2 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] vault.namespace = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] vault.root_token_id = **** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] vault.ssl_ca_crt_file = None {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] vault.timeout = 60.0 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] vault.use_ssl = False {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 06:24:00 devstack cinder-volume[85799]: DEBUG oslo_service.backend._eventlet.service [None req-1cc6d12c-27c1-4dda-a5fc-2687a9b82869 None None] ******************************************************************************** {{(pid=85799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 04 06:24:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] CMD "mount.quobyte" returned: 1 in 0.160s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:24:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:24:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:24:00 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:24:00 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:24:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:24:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:24:00 devstack sudo[86079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:24:00 devstack sudo[86079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:24:01 devstack sudo[86079]: pam_unix(sudo:session): session closed for user root Jun 04 06:24:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.610s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:24:01 devstack cinder-volume[86069]: INFO cinder.volume.driver [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] Driver hasn't implemented _init_vendor_properties() Jun 04 06:24:01 devstack cinder-volume[86069]: DEBUG cinder.volume.driver [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579765319824, 'free_capacity_gb': 1775.7579765319824, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86069) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 04 06:24:01 devstack cinder-volume[86069]: DEBUG oslo_db.sqlalchemy.engines [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86069) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 06:24:01 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writer thread running {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 04 06:24:01 devstack cinder-volume[86069]: DEBUG cinder.db.sqlalchemy.api [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] Building query based on filter {{(pid=86069) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3944}} Jun 04 06:24:01 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86069) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 04 06:24:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:24:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:24:01 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:24:01 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:24:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:24:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:24:01 devstack cinder-volume[86069]: INFO cinder.keymgr.migration [None req-77fe79ad-09c0-4731-ab9b-de4b83fcd54d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 04 06:24:01 devstack sudo[86090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:24:01 devstack sudo[86090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:24:02 devstack sudo[86090]: pam_unix(sudo:session): session closed for user root Jun 04 06:24:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.672s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:24:02 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:24:02 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] Driver initialization completed successfully. Jun 04 06:24:02 devstack cinder-volume[86069]: INFO cinder.manager [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] Initiating service 3 cleanup Jun 04 06:24:02 devstack cinder-volume[86069]: INFO cinder.manager [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] Service 3 cleanup completed. Jun 04 06:24:02 devstack cinder-volume[86069]: DEBUG cinder.service [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] Creating RPC server for service cinder-volume {{(pid=86069) start /opt/stack/cinder/cinder/service.py:231}} Jun 04 06:24:02 devstack cinder-volume[86069]: DEBUG cinder.service [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86069) start /opt/stack/cinder/cinder/service.py:237}} Jun 04 06:24:02 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 04 06:24:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:24:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:24:02 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:24:02 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:24:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:24:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:24:02 devstack sudo[86112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:24:02 devstack sudo[86112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:24:03 devstack sudo[86112]: pam_unix(sudo:session): session closed for user root Jun 04 06:24:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.605s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:24:03 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-171225c9-66f2-45fd-94fc-5b4bf3d333ad None None] Driver post RPC initialization completed successfully. Jun 04 06:24:10 devstack cinder-volume[85799]: DEBUG dbcounter [-] [85799] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85799) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:24:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager._thread_info {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:24:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread count: 6 {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 06:24:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread info: [<_MainThread(MainThread, started 131797370544256)>, , , , , ] {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 06:24:12 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=3 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:24:13 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:25:00 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:25:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] Flow 'volume_create_manager' (805a3154-2d14-4cff-8d30-46986f3f204b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:25:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (049d9c35-4c16-47a3-8b4d-33dfc4049e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:25:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (049d9c35-4c16-47a3-8b4d-33dfc4049e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-890381814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e9098c6-d73b-423f-942a-cb51f2fc70c2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7a8841587aab49b59b6429779ef1ca10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:25:01Z,use_quota=True,user_id='99acc4b5d3a24246b57cde3890572d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:25:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3bc30b-5f49-4399-b741-1c4be35a5b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:25:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3bc30b-5f49-4399-b741-1c4be35a5b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:25:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (634311ef-a366-48bc-8f4a-0b08ae75d303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:25:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (634311ef-a366-48bc-8f4a-0b08ae75d303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e9098c6-d73b-423f-942a-cb51f2fc70c2', 'volume_name': 'volume-1e9098c6-d73b-423f-942a-cb51f2fc70c2', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:25:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7594ed67-539c-4c82-a787-11853170e35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:25:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7594ed67-539c-4c82-a787-11853170e35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:25:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e7a09d3-9eda-4e89-83b6-4fa8b659523e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:25:00 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] Volume 1e9098c6-d73b-423f-942a-cb51f2fc70c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e9098c6-d73b-423f-942a-cb51f2fc70c2', 'volume_size': 1} Jun 04 06:25:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:25:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:25:00 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-890381814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e9098c6-d73b-423f-942a-cb51f2fc70c2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7a8841587aab49b59b6429779ef1ca10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:25:01Z,use_quota=True,user_id='99acc4b5d3a24246b57cde3890572d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:25:00 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] Creating volume 1e9098c6-d73b-423f-942a-cb51f2fc70c2 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:25:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:25:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:25:00 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:25:00 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:25:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:25:00 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:25:00 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:25:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1e9098c6-d73b-423f-942a-cb51f2fc70c2 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:01 devstack sudo[86483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1e9098c6-d73b-423f-942a-cb51f2fc70c2 1073741824 Jun 04 06:25:01 devstack sudo[86483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:02 devstack sudo[86483]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1e9098c6-d73b-423f-942a-cb51f2fc70c2 1073741824" returned: 0 in 1.386s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1e9098c6-d73b-423f-942a-cb51f2fc70c2 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:02 devstack sudo[87138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1e9098c6-d73b-423f-942a-cb51f2fc70c2 Jun 04 06:25:02 devstack sudo[87138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:03 devstack sudo[87138]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1e9098c6-d73b-423f-942a-cb51f2fc70c2" returned: 0 in 0.928s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:03 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] <== create_volume: return (2406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:25:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.409s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:25:03 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e7a09d3-9eda-4e89-83b6-4fa8b659523e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e9098c6-d73b-423f-942a-cb51f2fc70c2', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:25:03 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb3c51b-5fa8-4370-9578-b9e4a414bb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:25:03 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] Volume volume-1e9098c6-d73b-423f-942a-cb51f2fc70c2 (1e9098c6-d73b-423f-942a-cb51f2fc70c2): created successfully Jun 04 06:25:03 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb3c51b-5fa8-4370-9578-b9e4a414bb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:25:03 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] Flow 'volume_create_manager' (805a3154-2d14-4cff-8d30-46986f3f204b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:25:03 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-1bff0ade-8734-45bb-acdb-f11d4e12b512 req-5ff8bc24-9a6a-4ec0-a4f4-84633e33c904 tempest-VolumesGetTestJSON-361635751 None] Created volume successfully. Jun 04 06:25:05 devstack cinder-volume[86069]: DEBUG cinder.coordination [req-905b8204-acee-48fb-81ab-df13ca3dae80 req-68856da5-064b-488d-bef6-85d2e7308b77 tempest-VolumesGetTestJSON-361635751 None] Acquiring lock "cinder-1e9098c6-d73b-423f-942a-cb51f2fc70c2-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:25:05 devstack cinder-volume[86069]: DEBUG cinder.coordination [req-905b8204-acee-48fb-81ab-df13ca3dae80 req-68856da5-064b-488d-bef6-85d2e7308b77 tempest-VolumesGetTestJSON-361635751 None] Lock "cinder-1e9098c6-d73b-423f-942a-cb51f2fc70c2-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:25:05 devstack cinder-volume[86069]: DEBUG cinder.coordination [req-905b8204-acee-48fb-81ab-df13ca3dae80 req-68856da5-064b-488d-bef6-85d2e7308b77 tempest-VolumesGetTestJSON-361635751 None] Acquiring lock "cinder-quobyte-1e9098c6-d73b-423f-942a-cb51f2fc70c2" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:25:05 devstack cinder-volume[86069]: DEBUG cinder.coordination [req-905b8204-acee-48fb-81ab-df13ca3dae80 req-68856da5-064b-488d-bef6-85d2e7308b77 tempest-VolumesGetTestJSON-361635751 None] Lock "cinder-quobyte-1e9098c6-d73b-423f-942a-cb51f2fc70c2" acquired by "delete_volume" :: waited 0.039s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:25:05 devstack cinder-volume[86069]: INFO oslo.privsep.daemon [req-905b8204-acee-48fb-81ab-df13ca3dae80 req-68856da5-064b-488d-bef6-85d2e7308b77 tempest-VolumesGetTestJSON-361635751 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp_436zmq8/privsep.sock'] Jun 04 06:25:05 devstack sudo[87224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp_436zmq8/privsep.sock Jun 04 06:25:05 devstack sudo[87224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:08 devstack sudo[87224]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:08 devstack cinder-volume[86069]: INFO oslo.privsep.daemon [req-905b8204-acee-48fb-81ab-df13ca3dae80 req-68856da5-064b-488d-bef6-85d2e7308b77 tempest-VolumesGetTestJSON-361635751 None] Spawned new privsep daemon via rootwrap Jun 04 06:25:08 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [req-905b8204-acee-48fb-81ab-df13ca3dae80 req-68856da5-064b-488d-bef6-85d2e7308b77 tempest-VolumesGetTestJSON-361635751 None] Accepted privsep connection to /tmp/tmp_436zmq8/privsep.sock {{(pid=86069) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}} Jun 04 06:25:08 devstack cinder-volume[86069]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 04 06:25:08 devstack cinder-volume[86069]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 04 06:25:08 devstack cinder-volume[86069]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 04 06:25:08 devstack cinder-volume[86069]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87230 Jun 04 06:25:08 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4f7f94-d9cf-461b-adee-0f67ab263f2b]: (2,) {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:25:08 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55942d3-d50e-4a35-b047-3c6ff8939712]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:25:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-905b8204-acee-48fb-81ab-df13ca3dae80 req-68856da5-064b-488d-bef6-85d2e7308b77 tempest-VolumesGetTestJSON-361635751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1e9098c6-d73b-423f-942a-cb51f2fc70c2 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:08 devstack sudo[87232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1e9098c6-d73b-423f-942a-cb51f2fc70c2 Jun 04 06:25:08 devstack sudo[87232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:10 devstack sudo[87232]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-905b8204-acee-48fb-81ab-df13ca3dae80 req-68856da5-064b-488d-bef6-85d2e7308b77 tempest-VolumesGetTestJSON-361635751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1e9098c6-d73b-423f-942a-cb51f2fc70c2" returned: 0 in 1.607s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-905b8204-acee-48fb-81ab-df13ca3dae80 req-68856da5-064b-488d-bef6-85d2e7308b77 tempest-VolumesGetTestJSON-361635751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1e9098c6-d73b-423f-942a-cb51f2fc70c2 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:10 devstack sudo[87266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1e9098c6-d73b-423f-942a-cb51f2fc70c2 Jun 04 06:25:10 devstack sudo[87266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:25:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:25:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:25:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:25:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:25:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:25:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:11 devstack sudo[87280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:25:11 devstack sudo[87280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:11 devstack sudo[87266]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-905b8204-acee-48fb-81ab-df13ca3dae80 req-68856da5-064b-488d-bef6-85d2e7308b77 tempest-VolumesGetTestJSON-361635751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1e9098c6-d73b-423f-942a-cb51f2fc70c2" returned: 0 in 1.634s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:11 devstack cinder-volume[86069]: DEBUG cinder.coordination [req-905b8204-acee-48fb-81ab-df13ca3dae80 req-68856da5-064b-488d-bef6-85d2e7308b77 tempest-VolumesGetTestJSON-361635751 None] Lock "cinder-quobyte-1e9098c6-d73b-423f-942a-cb51f2fc70c2" released by "delete_volume" :: held 6.001s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:25:11 devstack cinder-volume[86069]: WARNING cinder.quota [req-905b8204-acee-48fb-81ab-df13ca3dae80 req-68856da5-064b-488d-bef6-85d2e7308b77 tempest-VolumesGetTestJSON-361635751 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 04 06:25:11 devstack cinder-volume[86069]: WARNING cinder.quota [req-905b8204-acee-48fb-81ab-df13ca3dae80 req-68856da5-064b-488d-bef6-85d2e7308b77 tempest-VolumesGetTestJSON-361635751 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 04 06:25:12 devstack cinder-volume[86069]: DEBUG cinder.quota [req-905b8204-acee-48fb-81ab-df13ca3dae80 req-68856da5-064b-488d-bef6-85d2e7308b77 tempest-VolumesGetTestJSON-361635751 None] Created reservations ['5696fc69-2260-4ba8-b59a-6314e685c909', '6fe42e25-eb12-4b41-a543-9168cec64d83', 'cc652c00-ee59-4877-b064-5c0d42961228', '1316036b-f316-4125-ba1b-e05727effc38'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:25:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-905b8204-acee-48fb-81ab-df13ca3dae80 req-68856da5-064b-488d-bef6-85d2e7308b77 tempest-VolumesGetTestJSON-361635751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:25:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-905b8204-acee-48fb-81ab-df13ca3dae80 req-68856da5-064b-488d-bef6-85d2e7308b77 tempest-VolumesGetTestJSON-361635751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:25:12 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [req-905b8204-acee-48fb-81ab-df13ca3dae80 req-68856da5-064b-488d-bef6-85d2e7308b77 tempest-VolumesGetTestJSON-361635751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:25:12 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [req-905b8204-acee-48fb-81ab-df13ca3dae80 req-68856da5-064b-488d-bef6-85d2e7308b77 tempest-VolumesGetTestJSON-361635751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:25:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-905b8204-acee-48fb-81ab-df13ca3dae80 req-68856da5-064b-488d-bef6-85d2e7308b77 tempest-VolumesGetTestJSON-361635751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:25:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-905b8204-acee-48fb-81ab-df13ca3dae80 req-68856da5-064b-488d-bef6-85d2e7308b77 tempest-VolumesGetTestJSON-361635751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:12 devstack sudo[87377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:25:12 devstack sudo[87377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:13 devstack sudo[87280]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 2.013s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:13 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:25:13 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager._thread_info {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:25:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread count: 8 {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 06:25:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread info: [<_MainThread(MainThread, started 131797370544256)>, , , , , , , ] {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 06:25:14 devstack sudo[87377]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-905b8204-acee-48fb-81ab-df13ca3dae80 req-68856da5-064b-488d-bef6-85d2e7308b77 tempest-VolumesGetTestJSON-361635751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 2.189s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:14 devstack cinder-volume[86069]: DEBUG cinder.manager [req-905b8204-acee-48fb-81ab-df13ca3dae80 req-68856da5-064b-488d-bef6-85d2e7308b77 tempest-VolumesGetTestJSON-361635751 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:25:14 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-905b8204-acee-48fb-81ab-df13ca3dae80 req-68856da5-064b-488d-bef6-85d2e7308b77 tempest-VolumesGetTestJSON-361635751 None] Deleted volume successfully. Jun 04 06:25:14 devstack cinder-volume[86069]: DEBUG cinder.coordination [req-905b8204-acee-48fb-81ab-df13ca3dae80 req-68856da5-064b-488d-bef6-85d2e7308b77 tempest-VolumesGetTestJSON-361635751 None] Lock "cinder-1e9098c6-d73b-423f-942a-cb51f2fc70c2-delete_volume" released by "delete_volume" :: held 8.839s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:25:19 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:25:19 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] Flow 'volume_create_manager' (fe55f735-b5f9-4650-88a9-47248bee6dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:25:19 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9255aaba-ce78-44cb-b357-6c1cfdf4016c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:25:19 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9255aaba-ce78-44cb-b357-6c1cfdf4016c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1469262875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b90475a-de1b-4474-aa48-a5559e7f528b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f715592f5ff54f11acdc40e8e94741a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:25:20Z,use_quota=True,user_id='cd02c712c2664866860446bdced32cb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:25:19 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c54d6dd-7990-4709-9ee7-b457db274906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:25:19 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c54d6dd-7990-4709-9ee7-b457db274906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:25:19 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceabe1fd-8a13-43db-9034-ca371f25b739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:25:19 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceabe1fd-8a13-43db-9034-ca371f25b739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b90475a-de1b-4474-aa48-a5559e7f528b', 'volume_name': 'volume-1b90475a-de1b-4474-aa48-a5559e7f528b', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:25:19 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9a97a37-424f-4a9b-96f4-86098b15e589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:25:19 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9a97a37-424f-4a9b-96f4-86098b15e589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:25:19 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa628c9b-3c06-4909-addb-41e1cb6e5b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:25:19 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] Volume 1b90475a-de1b-4474-aa48-a5559e7f528b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b90475a-de1b-4474-aa48-a5559e7f528b', 'volume_size': 1} Jun 04 06:25:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:25:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:25:19 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1469262875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b90475a-de1b-4474-aa48-a5559e7f528b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f715592f5ff54f11acdc40e8e94741a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:25:20Z,use_quota=True,user_id='cd02c712c2664866860446bdced32cb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:25:19 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] Creating volume 1b90475a-de1b-4474-aa48-a5559e7f528b {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:25:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:25:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:25:19 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:25:19 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:25:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:25:19 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:25:19 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:25:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1b90475a-de1b-4474-aa48-a5559e7f528b 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:19 devstack sudo[87489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1b90475a-de1b-4474-aa48-a5559e7f528b 1073741824 Jun 04 06:25:19 devstack sudo[87489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:21 devstack sudo[87489]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1b90475a-de1b-4474-aa48-a5559e7f528b 1073741824" returned: 0 in 1.794s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1b90475a-de1b-4474-aa48-a5559e7f528b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:21 devstack sudo[87496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1b90475a-de1b-4474-aa48-a5559e7f528b Jun 04 06:25:21 devstack sudo[87496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:23 devstack sudo[87496]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1b90475a-de1b-4474-aa48-a5559e7f528b" returned: 0 in 1.802s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:23 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] <== create_volume: return (3675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:25:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.679s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:25:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa628c9b-3c06-4909-addb-41e1cb6e5b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b90475a-de1b-4474-aa48-a5559e7f528b', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:25:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (245e4eaf-e2ce-4105-8049-5ab887f4cc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:25:23 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] Volume volume-1b90475a-de1b-4474-aa48-a5559e7f528b (1b90475a-de1b-4474-aa48-a5559e7f528b): created successfully Jun 04 06:25:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (245e4eaf-e2ce-4105-8049-5ab887f4cc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:25:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] Flow 'volume_create_manager' (fe55f735-b5f9-4650-88a9-47248bee6dbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:25:23 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-89b67aec-22fb-4eb0-bf0b-2e79cddc9745 tempest-VolumesAdminNegativeTest-75847599 None] Created volume successfully. Jun 04 06:25:24 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-feb97136-3162-4a63-a2cf-6aabc24c04e6 tempest-GroupSnapshotsTest-126993073 None] Group tempest-GroupSnapshotsTest-Group-1417892254: creating Jun 04 06:25:24 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-feb97136-3162-4a63-a2cf-6aabc24c04e6 tempest-GroupSnapshotsTest-126993073 None] Group tempest-GroupSnapshotsTest-Group-1417892254: created successfully Jun 04 06:25:24 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-feb97136-3162-4a63-a2cf-6aabc24c04e6 tempest-GroupSnapshotsTest-126993073 None] Create group completed successfully. Jun 04 06:25:25 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-fdf277bf-07ac-4d77-8cd8-1af7104fa1b3 tempest-VolumesAdminNegativeTest-75847599 None] Acquiring lock "cinder-1b90475a-de1b-4474-aa48-a5559e7f528b-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:25:25 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-fdf277bf-07ac-4d77-8cd8-1af7104fa1b3 tempest-VolumesAdminNegativeTest-75847599 None] Lock "cinder-1b90475a-de1b-4474-aa48-a5559e7f528b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:25:25 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-fdf277bf-07ac-4d77-8cd8-1af7104fa1b3 tempest-VolumesAdminNegativeTest-75847599 None] Acquiring lock "cinder-quobyte-1b90475a-de1b-4474-aa48-a5559e7f528b" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:25:25 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-fdf277bf-07ac-4d77-8cd8-1af7104fa1b3 tempest-VolumesAdminNegativeTest-75847599 None] Lock "cinder-quobyte-1b90475a-de1b-4474-aa48-a5559e7f528b" acquired by "delete_volume" :: waited 0.033s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:25:25 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4e2767-28b5-442d-b099-e6e70418e031]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:25:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fdf277bf-07ac-4d77-8cd8-1af7104fa1b3 tempest-VolumesAdminNegativeTest-75847599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1b90475a-de1b-4474-aa48-a5559e7f528b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:25 devstack sudo[87553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1b90475a-de1b-4474-aa48-a5559e7f528b Jun 04 06:25:25 devstack sudo[87553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:26 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:25:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] Flow 'volume_create_manager' (2bd6d3e9-b1be-41b7-bc35-bb1db550ac93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:25:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a160abfd-b721-4ea5-8506-a9696afdf964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:25:26 devstack sudo[87553]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fdf277bf-07ac-4d77-8cd8-1af7104fa1b3 tempest-VolumesAdminNegativeTest-75847599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1b90475a-de1b-4474-aa48-a5559e7f528b" returned: 0 in 1.274s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fdf277bf-07ac-4d77-8cd8-1af7104fa1b3 tempest-VolumesAdminNegativeTest-75847599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1b90475a-de1b-4474-aa48-a5559e7f528b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a160abfd-b721-4ea5-8506-a9696afdf964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-484280316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=66b5a167-737a-4a61-954f-bb148bf45ab5,host='devstack@QuobyteHD#QuobyteHD',id=c9992a12-20c8-4866-807e-2d267cd69b1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73173f8b881444eb88d5be8df9142877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:25:27Z,use_quota=True,user_id='2e8bc1dba17540cd8e7a65dd3caa2730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef0f9db1-7d96-4ddc-9ab0-06821d116b4d),volume_type_id=ef0f9db1-7d96-4ddc-9ab0-06821d116b4d)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:25:26 devstack sudo[87559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1b90475a-de1b-4474-aa48-a5559e7f528b Jun 04 06:25:26 devstack sudo[87559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bea64f3-28a5-4f60-b229-8429b759e7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:25:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bea64f3-28a5-4f60-b229-8429b759e7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:25:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74a9083c-9c59-4c8d-914d-c152d8c6dbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:25:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74a9083c-9c59-4c8d-914d-c152d8c6dbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9992a12-20c8-4866-807e-2d267cd69b1b', 'volume_name': 'volume-c9992a12-20c8-4866-807e-2d267cd69b1b', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:25:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59fc942b-156f-48ce-b246-b0abf58adcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:25:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59fc942b-156f-48ce-b246-b0abf58adcbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:25:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c566a13-f035-4c25-8cad-a7a72d0a5d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:25:26 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] Volume c9992a12-20c8-4866-807e-2d267cd69b1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9992a12-20c8-4866-807e-2d267cd69b1b', 'volume_size': 1} Jun 04 06:25:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:25:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:25:26 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=66b5a167-737a-4a61-954f-bb148bf45ab5,created_at=2026-06-04T04:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-484280316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=66b5a167-737a-4a61-954f-bb148bf45ab5,host='devstack@QuobyteHD#QuobyteHD',id=c9992a12-20c8-4866-807e-2d267cd69b1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73173f8b881444eb88d5be8df9142877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:25:27Z,use_quota=True,user_id='2e8bc1dba17540cd8e7a65dd3caa2730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef0f9db1-7d96-4ddc-9ab0-06821d116b4d),volume_type_id=ef0f9db1-7d96-4ddc-9ab0-06821d116b4d)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:25:26 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] Creating volume c9992a12-20c8-4866-807e-2d267cd69b1b {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:25:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:25:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:25:26 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:25:26 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:25:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:25:26 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:25:26 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:25:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:27 devstack sudo[87561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b 1073741824 Jun 04 06:25:27 devstack sudo[87561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:27 devstack sudo[87559]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fdf277bf-07ac-4d77-8cd8-1af7104fa1b3 tempest-VolumesAdminNegativeTest-75847599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1b90475a-de1b-4474-aa48-a5559e7f528b" returned: 0 in 0.939s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-fdf277bf-07ac-4d77-8cd8-1af7104fa1b3 tempest-VolumesAdminNegativeTest-75847599 None] Lock "cinder-quobyte-1b90475a-de1b-4474-aa48-a5559e7f528b" released by "delete_volume" :: held 2.279s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:25:27 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-fdf277bf-07ac-4d77-8cd8-1af7104fa1b3 tempest-VolumesAdminNegativeTest-75847599 None] Created reservations ['7bb27488-d2bb-4939-8507-b76bdf5fe8a5', 'b7972464-f75b-4038-8bd3-4ad4b41ed5f8', '66628c56-74f7-4941-b2ad-f6ca4a5a2eed', '0160061f-e4c3-4c9d-841a-af55feb21352'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:25:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-fdf277bf-07ac-4d77-8cd8-1af7104fa1b3 tempest-VolumesAdminNegativeTest-75847599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:25:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-fdf277bf-07ac-4d77-8cd8-1af7104fa1b3 tempest-VolumesAdminNegativeTest-75847599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:25:28 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-fdf277bf-07ac-4d77-8cd8-1af7104fa1b3 tempest-VolumesAdminNegativeTest-75847599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:25:28 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-fdf277bf-07ac-4d77-8cd8-1af7104fa1b3 tempest-VolumesAdminNegativeTest-75847599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:25:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-fdf277bf-07ac-4d77-8cd8-1af7104fa1b3 tempest-VolumesAdminNegativeTest-75847599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:25:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fdf277bf-07ac-4d77-8cd8-1af7104fa1b3 tempest-VolumesAdminNegativeTest-75847599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:28 devstack sudo[87568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:25:28 devstack sudo[87568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:28 devstack sudo[87561]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b 1073741824" returned: 0 in 1.541s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:28 devstack sudo[87571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b Jun 04 06:25:28 devstack sudo[87571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:28 devstack sudo[87568]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fdf277bf-07ac-4d77-8cd8-1af7104fa1b3 tempest-VolumesAdminNegativeTest-75847599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.770s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:28 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-fdf277bf-07ac-4d77-8cd8-1af7104fa1b3 tempest-VolumesAdminNegativeTest-75847599 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:25:28 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-fdf277bf-07ac-4d77-8cd8-1af7104fa1b3 tempest-VolumesAdminNegativeTest-75847599 None] Deleted volume successfully. Jun 04 06:25:28 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-fdf277bf-07ac-4d77-8cd8-1af7104fa1b3 tempest-VolumesAdminNegativeTest-75847599 None] Lock "cinder-1b90475a-de1b-4474-aa48-a5559e7f528b-delete_volume" released by "delete_volume" :: held 3.526s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:25:29 devstack sudo[87571]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b" returned: 0 in 1.210s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:29 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] <== create_volume: return (2809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:25:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.817s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:25:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c566a13-f035-4c25-8cad-a7a72d0a5d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9992a12-20c8-4866-807e-2d267cd69b1b', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:25:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25e0f414-2e24-4715-bba2-a34c62335bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:25:29 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] Volume volume-c9992a12-20c8-4866-807e-2d267cd69b1b (c9992a12-20c8-4866-807e-2d267cd69b1b): created successfully Jun 04 06:25:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25e0f414-2e24-4715-bba2-a34c62335bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:25:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] Flow 'volume_create_manager' (2bd6d3e9-b1be-41b7-bc35-bb1db550ac93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:25:29 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-873ed553-974f-43e6-866c-018f87965eba tempest-GroupSnapshotsTest-126993073 None] Created volume successfully. Jun 04 06:25:31 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-47690d73-7156-44a0-a0d0-c8144de81349 tempest-GroupSnapshotsTest-126993073 None] GroupSnapshot 46e8202e-1407-410e-9388-352f42f92e4c: creating. Jun 04 06:25:31 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-47690d73-7156-44a0-a0d0-c8144de81349 tempest-GroupSnapshotsTest-126993073 None] Group snapshot 46e8202e-1407-410e-9388-352f42f92e4c: creating. {{(pid=86069) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Jun 04 06:25:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-47690d73-7156-44a0-a0d0-c8144de81349 tempest-GroupSnapshotsTest-126993073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:25:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-47690d73-7156-44a0-a0d0-c8144de81349 tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:25:31 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-47690d73-7156-44a0-a0d0-c8144de81349 tempest-GroupSnapshotsTest-126993073 None] Creating offline snapshot 2db05a5f-c39f-475c-8979-23f247bd7644 of volume c9992a12-20c8-4866-807e-2d267cd69b1b {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:25:31 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[408c4282-7978-4c5b-b193-2993f4ae2ed8]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:25:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-47690d73-7156-44a0-a0d0-c8144de81349 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:31 devstack sudo[87656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b Jun 04 06:25:31 devstack sudo[87656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:32 devstack sudo[87656]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-47690d73-7156-44a0-a0d0-c8144de81349 tempest-GroupSnapshotsTest-126993073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b" returned: 0 in 1.022s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-47690d73-7156-44a0-a0d0-c8144de81349 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b.2db05a5f-c39f-475c-8979-23f247bd7644 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:32 devstack sudo[87662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b.2db05a5f-c39f-475c-8979-23f247bd7644 1G Jun 04 06:25:32 devstack sudo[87662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:33 devstack sudo[87662]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-47690d73-7156-44a0-a0d0-c8144de81349 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b.2db05a5f-c39f-475c-8979-23f247bd7644 1G" returned: 0 in 0.992s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-47690d73-7156-44a0-a0d0-c8144de81349 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9992a12-20c8-4866-807e-2d267cd69b1b -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b.2db05a5f-c39f-475c-8979-23f247bd7644 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:33 devstack sudo[87676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9992a12-20c8-4866-807e-2d267cd69b1b -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b.2db05a5f-c39f-475c-8979-23f247bd7644 Jun 04 06:25:33 devstack sudo[87676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:35 devstack sudo[87676]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-47690d73-7156-44a0-a0d0-c8144de81349 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9992a12-20c8-4866-807e-2d267cd69b1b -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b.2db05a5f-c39f-475c-8979-23f247bd7644" returned: 0 in 1.487s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:35 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-47690d73-7156-44a0-a0d0-c8144de81349 tempest-GroupSnapshotsTest-126993073 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b.2db05a5f-c39f-475c-8979-23f247bd7644 is being set with open permissions: ugo+rw: NotImplementedError Jun 04 06:25:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-47690d73-7156-44a0-a0d0-c8144de81349 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b.2db05a5f-c39f-475c-8979-23f247bd7644 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:35 devstack sudo[87683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b.2db05a5f-c39f-475c-8979-23f247bd7644 Jun 04 06:25:35 devstack sudo[87683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:36 devstack sudo[87683]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-47690d73-7156-44a0-a0d0-c8144de81349 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b.2db05a5f-c39f-475c-8979-23f247bd7644" returned: 0 in 1.203s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-47690d73-7156-44a0-a0d0-c8144de81349 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:36 devstack sudo[87688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b.info Jun 04 06:25:36 devstack sudo[87688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:37 devstack sudo[87688]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-47690d73-7156-44a0-a0d0-c8144de81349 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b.info" returned: 0 in 0.756s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:37 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-47690d73-7156-44a0-a0d0-c8144de81349 tempest-GroupSnapshotsTest-126993073 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b.info is being set with open permissions: ugo+rw: NotImplementedError Jun 04 06:25:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-47690d73-7156-44a0-a0d0-c8144de81349 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:37 devstack sudo[87691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b.info Jun 04 06:25:37 devstack sudo[87691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:37 devstack sudo[87691]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-47690d73-7156-44a0-a0d0-c8144de81349 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b.info" returned: 0 in 0.695s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-47690d73-7156-44a0-a0d0-c8144de81349 tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.344s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:25:38 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-47690d73-7156-44a0-a0d0-c8144de81349 tempest-GroupSnapshotsTest-126993073 None] group_snapshot 46e8202e-1407-410e-9388-352f42f92e4c: created successfully Jun 04 06:25:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:25:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:25:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] Acquiring lock "cinder-quobyte-2db05a5f-c39f-475c-8979-23f247bd7644-9b07a159-9fd6-4d2b-b7a5-9424e5a993d5" by "_create_volume_from_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:25:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] Lock "cinder-quobyte-2db05a5f-c39f-475c-8979-23f247bd7644-9b07a159-9fd6-4d2b-b7a5-9424e5a993d5" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:25:39 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] Creating volume 9b07a159-9fd6-4d2b-b7a5-9424e5a993d5 from snapshot 2db05a5f-c39f-475c-8979-23f247bd7644 {{(pid=86069) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 04 06:25:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:25:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:25:39 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:25:39 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:25:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:25:39 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:25:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] Acquiring lock "cinder-quobyte-9b07a159-9fd6-4d2b-b7a5-9424e5a993d5" by "_copy_volume_from_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:25:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] Lock "cinder-quobyte-9b07a159-9fd6-4d2b-b7a5-9424e5a993d5" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:25:39 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] snapshot: 2db05a5f-c39f-475c-8979-23f247bd7644, volume: 9b07a159-9fd6-4d2b-b7a5-9424e5a993d5, {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 06:25:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:25:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:25:40 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:25:40 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:25:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:25:40 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c613491-533c-4a81-be81-c60a6451bc95]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:25:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b.2db05a5f-c39f-475c-8979-23f247bd7644 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:40 devstack sudo[87724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b.2db05a5f-c39f-475c-8979-23f247bd7644 Jun 04 06:25:40 devstack sudo[87724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:40 devstack sudo[87724]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b.2db05a5f-c39f-475c-8979-23f247bd7644" returned: 0 in 0.876s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:40 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9992a12-20c8-4866-807e-2d267cd69b1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:25:40 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 06:25:40 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] Creating direct copy from snapshot {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 06:25:40 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[24eaa125-b4e3-454f-9200-6b61bb1656c3]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:25:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:41 devstack sudo[87729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b Jun 04 06:25:41 devstack sudo[87729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:41 devstack sudo[87729]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b" returned: 0 in 0.875s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:41 devstack cinder-volume[86069]: DEBUG cinder.utils [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] Path /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9b07a159-9fd6-4d2b-b7a5-9424e5a993d5 not found in is_blk_device check {{(pid=86069) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 04 06:25:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9b07a159-9fd6-4d2b-b7a5-9424e5a993d5 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:41 devstack sudo[87734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9b07a159-9fd6-4d2b-b7a5-9424e5a993d5 Jun 04 06:25:41 devstack sudo[87734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:48 devstack sudo[87734]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9b07a159-9fd6-4d2b-b7a5-9424e5a993d5" returned: 0 in 6.796s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:48 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fd6f37-0382-4b40-b710-696f4884545c]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:25:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:48 devstack sudo[87767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b Jun 04 06:25:48 devstack sudo[87767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:49 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:25:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] Flow 'volume_create_manager' (916dcdaa-901f-4e34-9e01-ae647ac944e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:25:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c9d3fbc-1db0-4b19-a8c9-8189145f978e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:25:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c9d3fbc-1db0-4b19-a8c9-8189145f978e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-21870602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=744ad3e8-e43b-4958-a878-a2b21ddd6d8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a74190651454db99fa8102c65aef29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:25:49Z,use_quota=True,user_id='8b397f2bdc344fdbbbcdf0d66abffea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:25:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc49555-662a-4ea6-a04c-7952fcad7972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:25:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc49555-662a-4ea6-a04c-7952fcad7972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:25:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6500772-724b-4bb2-91a7-f5763ba4d709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:25:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6500772-724b-4bb2-91a7-f5763ba4d709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '744ad3e8-e43b-4958-a878-a2b21ddd6d8e', 'volume_name': 'volume-744ad3e8-e43b-4958-a878-a2b21ddd6d8e', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:25:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fa97144-d849-4c60-8582-cfc65393278d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:25:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fa97144-d849-4c60-8582-cfc65393278d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:25:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08912bc3-7476-4b77-a279-3a43e9086654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:25:49 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] Volume 744ad3e8-e43b-4958-a878-a2b21ddd6d8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-744ad3e8-e43b-4958-a878-a2b21ddd6d8e', 'volume_size': 1} Jun 04 06:25:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:25:49 devstack sudo[87767]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b" returned: 0 in 1.057s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:49 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] Image conversion details: src /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b, size 1024.00 MB, duration 6.80 sec, destination /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9b07a159-9fd6-4d2b-b7a5-9424e5a993d5 {{(pid=86069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 06:25:49 devstack cinder-volume[86069]: INFO cinder.image.image_utils [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] Converted 1024.00 MB image at 150.64 MB/s Jun 04 06:25:49 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9b07a159-9fd6-4d2b-b7a5-9424e5a993d5 is being set with open permissions: ugo+rw: NotImplementedError Jun 04 06:25:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9b07a159-9fd6-4d2b-b7a5-9424e5a993d5 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:49 devstack sudo[87773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9b07a159-9fd6-4d2b-b7a5-9424e5a993d5 Jun 04 06:25:49 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:50 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9b07a159-9fd6-4d2b-b7a5-9424e5a993d5" returned: 0 in 0.651s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:50 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] Lock "cinder-quobyte-9b07a159-9fd6-4d2b-b7a5-9424e5a993d5" released by "_copy_volume_from_snapshot" :: held 10.468s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:25:50 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] Lock "cinder-quobyte-2db05a5f-c39f-475c-8979-23f247bd7644-9b07a159-9fd6-4d2b-b7a5-9424e5a993d5" released by "_create_volume_from_snapshot" :: held 10.510s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:25:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.533s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:25:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.178s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:25:50 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-21870602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=744ad3e8-e43b-4958-a878-a2b21ddd6d8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a74190651454db99fa8102c65aef29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:25:49Z,use_quota=True,user_id='8b397f2bdc344fdbbbcdf0d66abffea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:25:50 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] Creating volume 744ad3e8-e43b-4958-a878-a2b21ddd6d8e {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:25:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:25:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:25:50 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:25:50 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:25:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:25:50 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:25:50 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:25:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-744ad3e8-e43b-4958-a878-a2b21ddd6d8e 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:50 devstack sudo[87776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-744ad3e8-e43b-4958-a878-a2b21ddd6d8e 1073741824 Jun 04 06:25:50 devstack sudo[87776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:50 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-a78ecb84-b7bd-48db-9146-b9a8c597995e tempest-GroupSnapshotsTest-126993073 None] Create group from source-snapshot-46e8202e-1407-410e-9388-352f42f92e4c completed successfully. Jun 04 06:25:51 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-730d2a4b-8c86-482f-8eb3-fe65495d5726 tempest-GroupSnapshotsTest-126993073 None] Acquiring lock "cinder-quobyte-9b07a159-9fd6-4d2b-b7a5-9424e5a993d5" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:25:51 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-730d2a4b-8c86-482f-8eb3-fe65495d5726 tempest-GroupSnapshotsTest-126993073 None] Lock "cinder-quobyte-9b07a159-9fd6-4d2b-b7a5-9424e5a993d5" acquired by "delete_volume" :: waited 0.022s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:25:51 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8661e77-ffd9-41ad-9ce2-cb7b952ec2f7]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:25:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-730d2a4b-8c86-482f-8eb3-fe65495d5726 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9b07a159-9fd6-4d2b-b7a5-9424e5a993d5 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:51 devstack sudo[87784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9b07a159-9fd6-4d2b-b7a5-9424e5a993d5 Jun 04 06:25:51 devstack sudo[87784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:51 devstack sudo[87776]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-744ad3e8-e43b-4958-a878-a2b21ddd6d8e 1073741824" returned: 0 in 1.337s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-744ad3e8-e43b-4958-a878-a2b21ddd6d8e {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:51 devstack sudo[87786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-744ad3e8-e43b-4958-a878-a2b21ddd6d8e Jun 04 06:25:51 devstack sudo[87786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:52 devstack sudo[87784]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-730d2a4b-8c86-482f-8eb3-fe65495d5726 tempest-GroupSnapshotsTest-126993073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9b07a159-9fd6-4d2b-b7a5-9424e5a993d5" returned: 0 in 1.050s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-730d2a4b-8c86-482f-8eb3-fe65495d5726 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9b07a159-9fd6-4d2b-b7a5-9424e5a993d5 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:52 devstack sudo[87809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9b07a159-9fd6-4d2b-b7a5-9424e5a993d5 Jun 04 06:25:52 devstack sudo[87809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:52 devstack sudo[87786]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-744ad3e8-e43b-4958-a878-a2b21ddd6d8e" returned: 0 in 1.032s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:52 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] <== create_volume: return (2436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:25:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.453s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:25:52 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08912bc3-7476-4b77-a279-3a43e9086654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-744ad3e8-e43b-4958-a878-a2b21ddd6d8e', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:25:52 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120bfd6d-3bde-4574-be71-fd7e49ae4502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:25:52 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=32,cinder:UPDATE=35,cinder:DELETE=2,cinder:INSERT=6 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:25:52 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] Volume volume-744ad3e8-e43b-4958-a878-a2b21ddd6d8e (744ad3e8-e43b-4958-a878-a2b21ddd6d8e): created successfully Jun 04 06:25:52 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120bfd6d-3bde-4574-be71-fd7e49ae4502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:25:52 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] Flow 'volume_create_manager' (916dcdaa-901f-4e34-9e01-ae647ac944e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:25:52 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-0ed19d58-b46a-4685-a896-810b7fefc55d tempest-ServersNegativeTestJSON-472947055 None] Created volume successfully. Jun 04 06:25:53 devstack sudo[87809]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-730d2a4b-8c86-482f-8eb3-fe65495d5726 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9b07a159-9fd6-4d2b-b7a5-9424e5a993d5" returned: 0 in 0.802s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:53 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-730d2a4b-8c86-482f-8eb3-fe65495d5726 tempest-GroupSnapshotsTest-126993073 None] Lock "cinder-quobyte-9b07a159-9fd6-4d2b-b7a5-9424e5a993d5" released by "delete_volume" :: held 1.918s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:25:53 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:UPDATE=32,cinder:SELECT=30,cinder:INSERT=7,cinder:DELETE=4 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:25:53 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-730d2a4b-8c86-482f-8eb3-fe65495d5726 tempest-GroupSnapshotsTest-126993073 None] Created reservations ['f6110a0e-d51b-4fc7-84bc-3b1bee8c1a3b'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:25:53 devstack cinder-volume[86069]: WARNING cinder.quota [None req-730d2a4b-8c86-482f-8eb3-fe65495d5726 tempest-GroupSnapshotsTest-126993073 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1253554142 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1253554142, it is now deprecated. Please use the default quota class for default quota. Jun 04 06:25:53 devstack cinder-volume[86069]: WARNING cinder.quota [None req-730d2a4b-8c86-482f-8eb3-fe65495d5726 tempest-GroupSnapshotsTest-126993073 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1253554142 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1253554142, it is now deprecated. Please use the default quota class for default quota. Jun 04 06:25:53 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-730d2a4b-8c86-482f-8eb3-fe65495d5726 tempest-GroupSnapshotsTest-126993073 None] Created reservations ['b4a88535-9022-4fe4-a7b3-7d509bd2b292', '8c396963-b449-4750-a613-f1d312873675', '1d882015-4f09-4b54-bf0e-6c27c6fc0c0d', '9893bd97-09cd-4468-b1c9-71bc34265512'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:25:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-730d2a4b-8c86-482f-8eb3-fe65495d5726 tempest-GroupSnapshotsTest-126993073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:25:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-730d2a4b-8c86-482f-8eb3-fe65495d5726 tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:25:53 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-730d2a4b-8c86-482f-8eb3-fe65495d5726 tempest-GroupSnapshotsTest-126993073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:25:53 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-730d2a4b-8c86-482f-8eb3-fe65495d5726 tempest-GroupSnapshotsTest-126993073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:25:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-730d2a4b-8c86-482f-8eb3-fe65495d5726 tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:25:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-730d2a4b-8c86-482f-8eb3-fe65495d5726 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:53 devstack sudo[87814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:25:53 devstack sudo[87814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:54 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-59299583-9616-4b2d-8584-e71ce4bd8f23 tempest-GroupSnapshotsTest-126993073 None] group_snapshot 46e8202e-1407-410e-9388-352f42f92e4c: deleting Jun 04 06:25:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-59299583-9616-4b2d-8584-e71ce4bd8f23 tempest-GroupSnapshotsTest-126993073 None] group_snapshot 46e8202e-1407-410e-9388-352f42f92e4c: deleting {{(pid=86069) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Jun 04 06:25:54 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-59299583-9616-4b2d-8584-e71ce4bd8f23 tempest-GroupSnapshotsTest-126993073 None] Acquiring lock "cinder-quobyte-c9992a12-20c8-4866-807e-2d267cd69b1b" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:25:54 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-59299583-9616-4b2d-8584-e71ce4bd8f23 tempest-GroupSnapshotsTest-126993073 None] Lock "cinder-quobyte-c9992a12-20c8-4866-807e-2d267cd69b1b" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:25:54 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-59299583-9616-4b2d-8584-e71ce4bd8f23 tempest-GroupSnapshotsTest-126993073 None] Acquiring lock "cinder-quobyte-2db05a5f-c39f-475c-8979-23f247bd7644" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:25:54 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-59299583-9616-4b2d-8584-e71ce4bd8f23 tempest-GroupSnapshotsTest-126993073 None] Lock "cinder-quobyte-2db05a5f-c39f-475c-8979-23f247bd7644" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:25:54 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-59299583-9616-4b2d-8584-e71ce4bd8f23 tempest-GroupSnapshotsTest-126993073 None] Deleting offline snapshot 2db05a5f-c39f-475c-8979-23f247bd7644 of volume c9992a12-20c8-4866-807e-2d267cd69b1b {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:25:54 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-59299583-9616-4b2d-8584-e71ce4bd8f23 tempest-GroupSnapshotsTest-126993073 None] snapshot_file for this snap is: volume-c9992a12-20c8-4866-807e-2d267cd69b1b.2db05a5f-c39f-475c-8979-23f247bd7644 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:25:54 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[20df0cb0-ea69-47ea-9ba4-fac0b7963a1c]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:25:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-59299583-9616-4b2d-8584-e71ce4bd8f23 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b.2db05a5f-c39f-475c-8979-23f247bd7644 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:54 devstack sudo[87817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b.2db05a5f-c39f-475c-8979-23f247bd7644 Jun 04 06:25:54 devstack sudo[87817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:54 devstack sudo[87814]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-730d2a4b-8c86-482f-8eb3-fe65495d5726 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.121s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:54 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-730d2a4b-8c86-482f-8eb3-fe65495d5726 tempest-GroupSnapshotsTest-126993073 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:25:54 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-730d2a4b-8c86-482f-8eb3-fe65495d5726 tempest-GroupSnapshotsTest-126993073 None] Delete group completed successfully. Jun 04 06:25:55 devstack sudo[87817]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-59299583-9616-4b2d-8584-e71ce4bd8f23 tempest-GroupSnapshotsTest-126993073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b.2db05a5f-c39f-475c-8979-23f247bd7644" returned: 0 in 0.879s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-59299583-9616-4b2d-8584-e71ce4bd8f23 tempest-GroupSnapshotsTest-126993073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9992a12-20c8-4866-807e-2d267cd69b1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:25:55 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[562e9342-6f18-47b3-8768-5b4cd020081e]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:25:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-59299583-9616-4b2d-8584-e71ce4bd8f23 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:55 devstack sudo[87825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b Jun 04 06:25:55 devstack sudo[87825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:55 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:25:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] Flow 'volume_create_manager' (1ce11678-354e-4453-ac83-aac8d94fcb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:25:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c42a116-aaec-48ea-95f6-839d56a10fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:25:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c42a116-aaec-48ea-95f6-839d56a10fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-151944804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a64deb5-10d8-4952-af6b-ad4111f9c30e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a74190651454db99fa8102c65aef29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:25:56Z,use_quota=True,user_id='8b397f2bdc344fdbbbcdf0d66abffea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:25:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (055ee380-be71-410b-9361-4723e1efbc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:25:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (055ee380-be71-410b-9361-4723e1efbc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:25:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c6b96e9-286b-4423-83f3-760970127c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:25:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c6b96e9-286b-4423-83f3-760970127c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a64deb5-10d8-4952-af6b-ad4111f9c30e', 'volume_name': 'volume-2a64deb5-10d8-4952-af6b-ad4111f9c30e', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:25:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d056e02-6b0f-4242-98af-abfcd7e976a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:25:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d056e02-6b0f-4242-98af-abfcd7e976a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:25:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f847923b-28de-4f41-9ac5-154736b4a265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:25:55 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] Volume 2a64deb5-10d8-4952-af6b-ad4111f9c30e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a64deb5-10d8-4952-af6b-ad4111f9c30e', 'volume_size': 1} Jun 04 06:25:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:25:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:25:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-151944804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a64deb5-10d8-4952-af6b-ad4111f9c30e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a74190651454db99fa8102c65aef29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:25:56Z,use_quota=True,user_id='8b397f2bdc344fdbbbcdf0d66abffea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:25:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] Creating volume 2a64deb5-10d8-4952-af6b-ad4111f9c30e {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:25:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:25:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:25:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:25:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:25:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:25:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:25:55 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:25:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2a64deb5-10d8-4952-af6b-ad4111f9c30e 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:55 devstack sudo[87827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2a64deb5-10d8-4952-af6b-ad4111f9c30e 1073741824 Jun 04 06:25:55 devstack sudo[87827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:56 devstack sudo[87825]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-59299583-9616-4b2d-8584-e71ce4bd8f23 tempest-GroupSnapshotsTest-126993073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b" returned: 0 in 0.937s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-59299583-9616-4b2d-8584-e71ce4bd8f23 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b.2db05a5f-c39f-475c-8979-23f247bd7644 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:56 devstack sudo[87835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b.2db05a5f-c39f-475c-8979-23f247bd7644 Jun 04 06:25:56 devstack sudo[87835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:56 devstack sudo[87827]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2a64deb5-10d8-4952-af6b-ad4111f9c30e 1073741824" returned: 0 in 0.970s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2a64deb5-10d8-4952-af6b-ad4111f9c30e {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:56 devstack sudo[87847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2a64deb5-10d8-4952-af6b-ad4111f9c30e Jun 04 06:25:56 devstack sudo[87847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:57 devstack sudo[87835]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-59299583-9616-4b2d-8584-e71ce4bd8f23 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b.2db05a5f-c39f-475c-8979-23f247bd7644" returned: 0 in 0.853s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-59299583-9616-4b2d-8584-e71ce4bd8f23 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b.2db05a5f-c39f-475c-8979-23f247bd7644 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:57 devstack sudo[87852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b.2db05a5f-c39f-475c-8979-23f247bd7644 Jun 04 06:25:57 devstack sudo[87852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:25:57 devstack sudo[87847]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2a64deb5-10d8-4952-af6b-ad4111f9c30e" returned: 0 in 0.891s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:57 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] <== create_volume: return (1928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:25:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.931s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:25:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f847923b-28de-4f41-9ac5-154736b4a265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a64deb5-10d8-4952-af6b-ad4111f9c30e', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:25:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799f09c1-d9d3-4519-9114-7a7e0f4f0643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:25:57 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] Volume volume-2a64deb5-10d8-4952-af6b-ad4111f9c30e (2a64deb5-10d8-4952-af6b-ad4111f9c30e): created successfully Jun 04 06:25:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799f09c1-d9d3-4519-9114-7a7e0f4f0643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:25:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] Flow 'volume_create_manager' (1ce11678-354e-4453-ac83-aac8d94fcb07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:25:57 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-ec256b18-fa9e-42da-a940-a6cc29a79e87 tempest-ServersNegativeTestJSON-472947055 None] Created volume successfully. Jun 04 06:25:57 devstack sudo[87852]: pam_unix(sudo:session): session closed for user root Jun 04 06:25:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-59299583-9616-4b2d-8584-e71ce4bd8f23 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b.2db05a5f-c39f-475c-8979-23f247bd7644" returned: 0 in 0.886s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:25:58 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-59299583-9616-4b2d-8584-e71ce4bd8f23 tempest-GroupSnapshotsTest-126993073 None] Lock "cinder-quobyte-2db05a5f-c39f-475c-8979-23f247bd7644" released by "_delete_snapshot" :: held 3.722s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:25:58 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-59299583-9616-4b2d-8584-e71ce4bd8f23 tempest-GroupSnapshotsTest-126993073 None] Lock "cinder-quobyte-c9992a12-20c8-4866-807e-2d267cd69b1b" released by "delete_snapshot" :: held 3.760s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:25:58 devstack cinder-volume[86069]: WARNING cinder.quota [None req-59299583-9616-4b2d-8584-e71ce4bd8f23 tempest-GroupSnapshotsTest-126993073 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1253554142 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1253554142, it is now deprecated. Please use the default quota class for default quota. Jun 04 06:25:58 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-59299583-9616-4b2d-8584-e71ce4bd8f23 tempest-GroupSnapshotsTest-126993073 None] Created reservations ['f4e87f4d-7768-4b5b-af03-f7940091aa8a', '8b02f7c6-48c8-43cd-9229-6924dd308c60', 'bc3726d6-b424-4aa6-9846-7a2bc13cf1b5', '45d17a87-0df1-432e-95fa-dd9a31113a6b'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:25:58 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-59299583-9616-4b2d-8584-e71ce4bd8f23 tempest-GroupSnapshotsTest-126993073 None] group_snapshot 46e8202e-1407-410e-9388-352f42f92e4c: deleted successfully Jun 04 06:25:59 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a63be9bc-b793-421e-8103-aaf75f29a039 tempest-GroupSnapshotsTest-126993073 None] Acquiring lock "cinder-quobyte-c9992a12-20c8-4866-807e-2d267cd69b1b" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:25:59 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a63be9bc-b793-421e-8103-aaf75f29a039 tempest-GroupSnapshotsTest-126993073 None] Lock "cinder-quobyte-c9992a12-20c8-4866-807e-2d267cd69b1b" acquired by "delete_volume" :: waited 0.035s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:25:59 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ce4984-f33e-4f4d-a6f3-6b1416ea2919]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:25:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a63be9bc-b793-421e-8103-aaf75f29a039 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:25:59 devstack sudo[87917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b Jun 04 06:25:59 devstack sudo[87917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:00 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ebf32796-bc24-46f7-be64-1d68746b0acc tempest-ServersNegativeTestJSON-472947055 None] Acquiring lock "cinder-2a64deb5-10d8-4952-af6b-ad4111f9c30e-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:26:00 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ebf32796-bc24-46f7-be64-1d68746b0acc tempest-ServersNegativeTestJSON-472947055 None] Lock "cinder-2a64deb5-10d8-4952-af6b-ad4111f9c30e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:26:00 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ebf32796-bc24-46f7-be64-1d68746b0acc tempest-ServersNegativeTestJSON-472947055 None] Acquiring lock "cinder-quobyte-2a64deb5-10d8-4952-af6b-ad4111f9c30e" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:26:00 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ebf32796-bc24-46f7-be64-1d68746b0acc tempest-ServersNegativeTestJSON-472947055 None] Lock "cinder-quobyte-2a64deb5-10d8-4952-af6b-ad4111f9c30e" acquired by "delete_volume" :: waited 0.042s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:26:00 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[58309401-2f8f-418e-b7c3-ca994c0f39bc]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:26:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ebf32796-bc24-46f7-be64-1d68746b0acc tempest-ServersNegativeTestJSON-472947055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2a64deb5-10d8-4952-af6b-ad4111f9c30e {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:00 devstack sudo[87923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2a64deb5-10d8-4952-af6b-ad4111f9c30e Jun 04 06:26:00 devstack sudo[87923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:00 devstack sudo[87917]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a63be9bc-b793-421e-8103-aaf75f29a039 tempest-GroupSnapshotsTest-126993073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b" returned: 0 in 1.357s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a63be9bc-b793-421e-8103-aaf75f29a039 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:00 devstack sudo[87928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b Jun 04 06:26:00 devstack sudo[87928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:01 devstack sudo[87928]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a63be9bc-b793-421e-8103-aaf75f29a039 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9992a12-20c8-4866-807e-2d267cd69b1b" returned: 0 in 0.866s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:01 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a63be9bc-b793-421e-8103-aaf75f29a039 tempest-GroupSnapshotsTest-126993073 None] Lock "cinder-quobyte-c9992a12-20c8-4866-807e-2d267cd69b1b" released by "delete_volume" :: held 2.381s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:26:01 devstack sudo[87923]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ebf32796-bc24-46f7-be64-1d68746b0acc tempest-ServersNegativeTestJSON-472947055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2a64deb5-10d8-4952-af6b-ad4111f9c30e" returned: 0 in 1.519s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ebf32796-bc24-46f7-be64-1d68746b0acc tempest-ServersNegativeTestJSON-472947055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2a64deb5-10d8-4952-af6b-ad4111f9c30e {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:01 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-a63be9bc-b793-421e-8103-aaf75f29a039 tempest-GroupSnapshotsTest-126993073 None] Created reservations ['5f3dc339-1a86-4d56-8cca-c3a8a26e0393'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:26:01 devstack sudo[87934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2a64deb5-10d8-4952-af6b-ad4111f9c30e Jun 04 06:26:01 devstack sudo[87934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:01 devstack cinder-volume[86069]: WARNING cinder.db.sqlalchemy.api [None req-a63be9bc-b793-421e-8103-aaf75f29a039 tempest-GroupSnapshotsTest-126993073 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1253554142'] Jun 04 06:26:01 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-a63be9bc-b793-421e-8103-aaf75f29a039 tempest-GroupSnapshotsTest-126993073 None] Created reservations ['24b3bc30-ee3c-4b93-8ded-6112613731c1', '3f2e4705-a498-436f-a1a5-b9f93c0d6fc0', '28081aea-de29-416f-ac75-e8954bcfd70a', '704f7617-936f-4d29-91e6-a16e9fd57db6'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:26:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a63be9bc-b793-421e-8103-aaf75f29a039 tempest-GroupSnapshotsTest-126993073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:26:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a63be9bc-b793-421e-8103-aaf75f29a039 tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:26:02 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a63be9bc-b793-421e-8103-aaf75f29a039 tempest-GroupSnapshotsTest-126993073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:26:02 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a63be9bc-b793-421e-8103-aaf75f29a039 tempest-GroupSnapshotsTest-126993073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:26:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a63be9bc-b793-421e-8103-aaf75f29a039 tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:26:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a63be9bc-b793-421e-8103-aaf75f29a039 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:02 devstack sudo[87936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:26:02 devstack sudo[87936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:02 devstack sudo[87934]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ebf32796-bc24-46f7-be64-1d68746b0acc tempest-ServersNegativeTestJSON-472947055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2a64deb5-10d8-4952-af6b-ad4111f9c30e" returned: 0 in 1.012s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:02 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ebf32796-bc24-46f7-be64-1d68746b0acc tempest-ServersNegativeTestJSON-472947055 None] Lock "cinder-quobyte-2a64deb5-10d8-4952-af6b-ad4111f9c30e" released by "delete_volume" :: held 2.651s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:26:02 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-ebf32796-bc24-46f7-be64-1d68746b0acc tempest-ServersNegativeTestJSON-472947055 None] Created reservations ['f74b467e-0c09-42a5-8800-23a0c0042903', '89248f55-98af-4c79-ab2f-9b5dbba173f8', 'c9a7e7db-e0b1-4d59-ad81-dcef9dbc8379', '783ae4f4-d59d-4e9f-b5d1-7b6e22955b09'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:26:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ebf32796-bc24-46f7-be64-1d68746b0acc tempest-ServersNegativeTestJSON-472947055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:26:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ebf32796-bc24-46f7-be64-1d68746b0acc tempest-ServersNegativeTestJSON-472947055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:26:03 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ebf32796-bc24-46f7-be64-1d68746b0acc tempest-ServersNegativeTestJSON-472947055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:26:03 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ebf32796-bc24-46f7-be64-1d68746b0acc tempest-ServersNegativeTestJSON-472947055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:26:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ebf32796-bc24-46f7-be64-1d68746b0acc tempest-ServersNegativeTestJSON-472947055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:26:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ebf32796-bc24-46f7-be64-1d68746b0acc tempest-ServersNegativeTestJSON-472947055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:03 devstack sudo[87939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:26:03 devstack sudo[87939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:03 devstack sudo[87936]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a63be9bc-b793-421e-8103-aaf75f29a039 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.338s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:03 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-a63be9bc-b793-421e-8103-aaf75f29a039 tempest-GroupSnapshotsTest-126993073 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:26:03 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-a63be9bc-b793-421e-8103-aaf75f29a039 tempest-GroupSnapshotsTest-126993073 None] Delete group completed successfully. Jun 04 06:26:03 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7b5121bd-b44a-430e-b282-410fa564a89b tempest-ServersNegativeTestJSON-472947055 None] Acquiring lock "cinder-744ad3e8-e43b-4958-a878-a2b21ddd6d8e-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:26:03 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7b5121bd-b44a-430e-b282-410fa564a89b tempest-ServersNegativeTestJSON-472947055 None] Lock "cinder-744ad3e8-e43b-4958-a878-a2b21ddd6d8e-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:26:03 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7b5121bd-b44a-430e-b282-410fa564a89b tempest-ServersNegativeTestJSON-472947055 None] Acquiring lock "cinder-quobyte-744ad3e8-e43b-4958-a878-a2b21ddd6d8e" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:26:03 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7b5121bd-b44a-430e-b282-410fa564a89b tempest-ServersNegativeTestJSON-472947055 None] Lock "cinder-quobyte-744ad3e8-e43b-4958-a878-a2b21ddd6d8e" acquired by "delete_volume" :: waited 0.039s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:26:03 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-dfac9e7d-7a97-43ac-bcdd-e413939bd48f tempest-GroupSnapshotsTest-126993073 None] Group tempest-GroupSnapshotsTest-Group-314861871: creating Jun 04 06:26:03 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[754924a2-060d-45a4-9659-d4de004d9bc2]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:26:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7b5121bd-b44a-430e-b282-410fa564a89b tempest-ServersNegativeTestJSON-472947055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-744ad3e8-e43b-4958-a878-a2b21ddd6d8e {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:03 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-dfac9e7d-7a97-43ac-bcdd-e413939bd48f tempest-GroupSnapshotsTest-126993073 None] Group tempest-GroupSnapshotsTest-Group-314861871: created successfully Jun 04 06:26:04 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-dfac9e7d-7a97-43ac-bcdd-e413939bd48f tempest-GroupSnapshotsTest-126993073 None] Create group completed successfully. Jun 04 06:26:04 devstack sudo[87944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-744ad3e8-e43b-4958-a878-a2b21ddd6d8e Jun 04 06:26:04 devstack sudo[87944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:04 devstack sudo[87939]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ebf32796-bc24-46f7-be64-1d68746b0acc tempest-ServersNegativeTestJSON-472947055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.470s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:04 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-ebf32796-bc24-46f7-be64-1d68746b0acc tempest-ServersNegativeTestJSON-472947055 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:26:04 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-ebf32796-bc24-46f7-be64-1d68746b0acc tempest-ServersNegativeTestJSON-472947055 None] Deleted volume successfully. Jun 04 06:26:04 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ebf32796-bc24-46f7-be64-1d68746b0acc tempest-ServersNegativeTestJSON-472947055 None] Lock "cinder-2a64deb5-10d8-4952-af6b-ad4111f9c30e-delete_volume" released by "delete_volume" :: held 4.544s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:26:05 devstack sudo[87944]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7b5121bd-b44a-430e-b282-410fa564a89b tempest-ServersNegativeTestJSON-472947055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-744ad3e8-e43b-4958-a878-a2b21ddd6d8e" returned: 0 in 1.276s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7b5121bd-b44a-430e-b282-410fa564a89b tempest-ServersNegativeTestJSON-472947055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-744ad3e8-e43b-4958-a878-a2b21ddd6d8e {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:05 devstack sudo[87951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-744ad3e8-e43b-4958-a878-a2b21ddd6d8e Jun 04 06:26:05 devstack sudo[87951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:05 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:26:05 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] Flow 'volume_create_manager' (abbb899f-f62c-47e9-ac9d-b586bf2c6e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:26:05 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764c1e83-9bfe-4266-b38e-dc43fed26c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:26:05 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764c1e83-9bfe-4266-b38e-dc43fed26c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-280087656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=789e35c3-d1e7-4876-b6ea-345e8f5d0dd9,host='devstack@QuobyteHD#QuobyteHD',id=8beeddde-35e4-40cd-b1df-60d73145f997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73173f8b881444eb88d5be8df9142877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:26:06Z,use_quota=True,user_id='2e8bc1dba17540cd8e7a65dd3caa2730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4faa7a5c-d79f-4669-92c3-102746b2bc51),volume_type_id=4faa7a5c-d79f-4669-92c3-102746b2bc51)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:26:05 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a619a40a-74eb-44d1-b362-766b4e29c13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:26:05 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a619a40a-74eb-44d1-b362-766b4e29c13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:26:05 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (558a0ece-3a1f-49ed-bfbb-4c9d43cffcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:26:06 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (558a0ece-3a1f-49ed-bfbb-4c9d43cffcb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8beeddde-35e4-40cd-b1df-60d73145f997', 'volume_name': 'volume-8beeddde-35e4-40cd-b1df-60d73145f997', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:26:06 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bed41aa-05d4-444f-ab27-da3c6118c623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:26:06 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bed41aa-05d4-444f-ab27-da3c6118c623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:26:06 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86ff1886-f876-41eb-a1a6-cfcf38d2d324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:26:06 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] Volume 8beeddde-35e4-40cd-b1df-60d73145f997: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8beeddde-35e4-40cd-b1df-60d73145f997', 'volume_size': 1} Jun 04 06:26:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:26:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:26:06 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=789e35c3-d1e7-4876-b6ea-345e8f5d0dd9,created_at=2026-06-04T04:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-280087656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=789e35c3-d1e7-4876-b6ea-345e8f5d0dd9,host='devstack@QuobyteHD#QuobyteHD',id=8beeddde-35e4-40cd-b1df-60d73145f997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73173f8b881444eb88d5be8df9142877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:26:06Z,use_quota=True,user_id='2e8bc1dba17540cd8e7a65dd3caa2730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4faa7a5c-d79f-4669-92c3-102746b2bc51),volume_type_id=4faa7a5c-d79f-4669-92c3-102746b2bc51)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:26:06 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] Creating volume 8beeddde-35e4-40cd-b1df-60d73145f997 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:26:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:26:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:26:06 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:26:06 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:26:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:26:06 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:26:06 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:26:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:06 devstack sudo[87965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997 1073741824 Jun 04 06:26:06 devstack sudo[87965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:06 devstack sudo[87951]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7b5121bd-b44a-430e-b282-410fa564a89b tempest-ServersNegativeTestJSON-472947055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-744ad3e8-e43b-4958-a878-a2b21ddd6d8e" returned: 0 in 1.350s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:06 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7b5121bd-b44a-430e-b282-410fa564a89b tempest-ServersNegativeTestJSON-472947055 None] Lock "cinder-quobyte-744ad3e8-e43b-4958-a878-a2b21ddd6d8e" released by "delete_volume" :: held 2.758s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:26:06 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-7b5121bd-b44a-430e-b282-410fa564a89b tempest-ServersNegativeTestJSON-472947055 None] Created reservations ['69743d0f-1627-4bb7-97c9-31cf1173bb34', '46d688e2-e397-40ee-a726-bf72de09c0ba', '2022409c-4daa-415d-84f0-a9563b463a14', '45b059e6-a9af-47d3-885f-bfa51942a052'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:26:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7b5121bd-b44a-430e-b282-410fa564a89b tempest-ServersNegativeTestJSON-472947055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:26:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7b5121bd-b44a-430e-b282-410fa564a89b tempest-ServersNegativeTestJSON-472947055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:26:06 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7b5121bd-b44a-430e-b282-410fa564a89b tempest-ServersNegativeTestJSON-472947055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:26:06 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7b5121bd-b44a-430e-b282-410fa564a89b tempest-ServersNegativeTestJSON-472947055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:26:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7b5121bd-b44a-430e-b282-410fa564a89b tempest-ServersNegativeTestJSON-472947055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:26:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7b5121bd-b44a-430e-b282-410fa564a89b tempest-ServersNegativeTestJSON-472947055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:06 devstack sudo[87972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:26:06 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:07 devstack sudo[87965]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997 1073741824" returned: 0 in 1.855s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:08 devstack sudo[87979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997 Jun 04 06:26:08 devstack sudo[87979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:08 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7b5121bd-b44a-430e-b282-410fa564a89b tempest-ServersNegativeTestJSON-472947055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.454s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:08 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-7b5121bd-b44a-430e-b282-410fa564a89b tempest-ServersNegativeTestJSON-472947055 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:26:08 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-7b5121bd-b44a-430e-b282-410fa564a89b tempest-ServersNegativeTestJSON-472947055 None] Deleted volume successfully. Jun 04 06:26:08 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7b5121bd-b44a-430e-b282-410fa564a89b tempest-ServersNegativeTestJSON-472947055 None] Lock "cinder-744ad3e8-e43b-4958-a878-a2b21ddd6d8e-delete_volume" released by "delete_volume" :: held 4.717s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:26:08 devstack sudo[87979]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997" returned: 0 in 0.940s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:08 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] <== create_volume: return (2907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:26:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.919s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:26:09 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86ff1886-f876-41eb-a1a6-cfcf38d2d324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8beeddde-35e4-40cd-b1df-60d73145f997', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:26:09 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (609719b5-a3e1-4dc7-852f-3746bbd9f11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:26:09 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] Volume volume-8beeddde-35e4-40cd-b1df-60d73145f997 (8beeddde-35e4-40cd-b1df-60d73145f997): created successfully Jun 04 06:26:09 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (609719b5-a3e1-4dc7-852f-3746bbd9f11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:26:09 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] Flow 'volume_create_manager' (abbb899f-f62c-47e9-ac9d-b586bf2c6e26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:26:09 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-04cba910-55f2-431b-ad0c-035d5e7dee78 tempest-GroupSnapshotsTest-126993073 None] Created volume successfully. Jun 04 06:26:10 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:26:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] Flow 'volume_create_manager' (69be58f5-7f85-4b7f-9c03-f99836d91794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:26:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e890460-3355-4ba0-97bc-489ae986dc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:26:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e890460-3355-4ba0-97bc-489ae986dc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1140446642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=789e35c3-d1e7-4876-b6ea-345e8f5d0dd9,host='devstack@QuobyteHD#QuobyteHD',id=5bb72138-7c58-427e-9f73-0f8ff59cadf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73173f8b881444eb88d5be8df9142877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:26:10Z,use_quota=True,user_id='2e8bc1dba17540cd8e7a65dd3caa2730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4faa7a5c-d79f-4669-92c3-102746b2bc51),volume_type_id=4faa7a5c-d79f-4669-92c3-102746b2bc51)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:26:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c29d167b-c493-45b1-9d62-54ebfb66b987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:26:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c29d167b-c493-45b1-9d62-54ebfb66b987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:26:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8057619e-4f81-4f2d-b859-16d9a31f7b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:26:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8057619e-4f81-4f2d-b859-16d9a31f7b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bb72138-7c58-427e-9f73-0f8ff59cadf5', 'volume_name': 'volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:26:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f7726b2-88d9-4db9-a39d-2d4afc87ede2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:26:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f7726b2-88d9-4db9-a39d-2d4afc87ede2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:26:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fcda304-55bd-4beb-997d-1126cb4260d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:26:10 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] Volume 5bb72138-7c58-427e-9f73-0f8ff59cadf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5', 'volume_size': 1} Jun 04 06:26:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:26:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:26:10 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=789e35c3-d1e7-4876-b6ea-345e8f5d0dd9,created_at=2026-06-04T04:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1140446642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=789e35c3-d1e7-4876-b6ea-345e8f5d0dd9,host='devstack@QuobyteHD#QuobyteHD',id=5bb72138-7c58-427e-9f73-0f8ff59cadf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73173f8b881444eb88d5be8df9142877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:26:10Z,use_quota=True,user_id='2e8bc1dba17540cd8e7a65dd3caa2730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4faa7a5c-d79f-4669-92c3-102746b2bc51),volume_type_id=4faa7a5c-d79f-4669-92c3-102746b2bc51)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:26:10 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] Creating volume 5bb72138-7c58-427e-9f73-0f8ff59cadf5 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:26:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:26:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:26:10 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:26:10 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:26:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:26:10 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:26:10 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:26:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:10 devstack sudo[88021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5 1073741824 Jun 04 06:26:10 devstack sudo[88021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:26:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:26:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:26:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:26:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:26:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:26:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:11 devstack sudo[88023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:26:11 devstack sudo[88023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:12 devstack sudo[88021]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5 1073741824" returned: 0 in 1.423s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:12 devstack sudo[88035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5 Jun 04 06:26:12 devstack sudo[88035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:12 devstack sudo[88023]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.056s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:12 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:26:12 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager._thread_info {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:26:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread count: 8 {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 06:26:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread info: [<_MainThread(MainThread, started 131797370544256)>, , , , , , , ] {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 06:26:12 devstack sudo[88035]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5" returned: 0 in 0.817s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:12 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] <== create_volume: return (2303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:26:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.308s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:26:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fcda304-55bd-4beb-997d-1126cb4260d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:26:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cff51b4-2389-4df3-9ef6-168b59238c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:26:12 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] Volume volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5 (5bb72138-7c58-427e-9f73-0f8ff59cadf5): created successfully Jun 04 06:26:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cff51b4-2389-4df3-9ef6-168b59238c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:26:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] Flow 'volume_create_manager' (69be58f5-7f85-4b7f-9c03-f99836d91794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:26:12 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-a8bf51fd-254c-4de5-ba24-b50d80170cc3 tempest-GroupSnapshotsTest-126993073 None] Created volume successfully. Jun 04 06:26:14 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-d64ed757-48b9-4add-b99b-608bea451b4d tempest-GroupSnapshotsTest-126993073 None] Update group completed successfully. Jun 04 06:26:15 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-6035e14f-c321-49ff-95c1-4632da2071a1 tempest-GroupSnapshotsTest-126993073 None] Update group completed successfully. Jun 04 06:26:16 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-978b5f4b-7a2f-43cf-8508-9373a3d96a03 tempest-GroupSnapshotsTest-126993073 None] Update group completed successfully. Jun 04 06:26:17 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-700bb19f-3e2c-42d9-a539-e99817af52e8 tempest-GroupSnapshotsTest-126993073 None] Update group completed successfully. Jun 04 06:26:19 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] GroupSnapshot 01f37fa5-cd12-4b81-b5ee-85b279de7e06: creating. Jun 04 06:26:19 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] Group snapshot 01f37fa5-cd12-4b81-b5ee-85b279de7e06: creating. {{(pid=86069) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Jun 04 06:26:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:26:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:26:19 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] Creating offline snapshot 65f714d1-d071-4632-adb9-79b221fc3dcc of volume 8beeddde-35e4-40cd-b1df-60d73145f997 {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:26:19 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2e797e-6a3f-44fe-b410-c284e0480aa9]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:26:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:19 devstack sudo[88097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997 Jun 04 06:26:19 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:20 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997" returned: 0 in 0.857s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997.65f714d1-d071-4632-adb9-79b221fc3dcc 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:20 devstack sudo[88102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997.65f714d1-d071-4632-adb9-79b221fc3dcc 1G Jun 04 06:26:20 devstack sudo[88102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:21 devstack sudo[88102]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997.65f714d1-d071-4632-adb9-79b221fc3dcc 1G" returned: 0 in 1.161s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8beeddde-35e4-40cd-b1df-60d73145f997 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997.65f714d1-d071-4632-adb9-79b221fc3dcc {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:21 devstack sudo[88109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8beeddde-35e4-40cd-b1df-60d73145f997 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997.65f714d1-d071-4632-adb9-79b221fc3dcc Jun 04 06:26:21 devstack sudo[88109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:22 devstack sudo[88109]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8beeddde-35e4-40cd-b1df-60d73145f997 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997.65f714d1-d071-4632-adb9-79b221fc3dcc" returned: 0 in 0.774s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:22 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997.65f714d1-d071-4632-adb9-79b221fc3dcc is being set with open permissions: ugo+rw: NotImplementedError Jun 04 06:26:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997.65f714d1-d071-4632-adb9-79b221fc3dcc {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:22 devstack sudo[88115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997.65f714d1-d071-4632-adb9-79b221fc3dcc Jun 04 06:26:22 devstack sudo[88115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:22 devstack sudo[88115]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997.65f714d1-d071-4632-adb9-79b221fc3dcc" returned: 0 in 0.736s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:22 devstack sudo[88119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997.info Jun 04 06:26:22 devstack sudo[88119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:23 devstack sudo[88119]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997.info" returned: 0 in 0.759s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:23 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997.info is being set with open permissions: ugo+rw: NotImplementedError Jun 04 06:26:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:23 devstack sudo[88125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997.info Jun 04 06:26:23 devstack sudo[88125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:24 devstack sudo[88125]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997.info" returned: 0 in 0.643s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.067s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:26:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:26:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:26:24 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] Creating offline snapshot 8c167da1-86c0-49f4-ab9b-9e7195a60aeb of volume 5bb72138-7c58-427e-9f73-0f8ff59cadf5 {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:26:24 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d7a750-4101-485c-98f6-9df8e176cf74]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:26:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:24 devstack sudo[88128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5 Jun 04 06:26:24 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:25 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5" returned: 0 in 0.757s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5.8c167da1-86c0-49f4-ab9b-9e7195a60aeb 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:25 devstack sudo[88134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5.8c167da1-86c0-49f4-ab9b-9e7195a60aeb 1G Jun 04 06:26:25 devstack sudo[88134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:25 devstack sudo[88134]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5.8c167da1-86c0-49f4-ab9b-9e7195a60aeb 1G" returned: 0 in 0.840s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5.8c167da1-86c0-49f4-ab9b-9e7195a60aeb {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:26 devstack sudo[88142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5.8c167da1-86c0-49f4-ab9b-9e7195a60aeb Jun 04 06:26:26 devstack sudo[88142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:26 devstack sudo[88142]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5.8c167da1-86c0-49f4-ab9b-9e7195a60aeb" returned: 0 in 0.738s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:26 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5.8c167da1-86c0-49f4-ab9b-9e7195a60aeb is being set with open permissions: ugo+rw: NotImplementedError Jun 04 06:26:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5.8c167da1-86c0-49f4-ab9b-9e7195a60aeb {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:26 devstack sudo[88148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5.8c167da1-86c0-49f4-ab9b-9e7195a60aeb Jun 04 06:26:26 devstack sudo[88148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:27 devstack sudo[88148]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5.8c167da1-86c0-49f4-ab9b-9e7195a60aeb" returned: 0 in 0.756s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:27 devstack sudo[88157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5.info Jun 04 06:26:27 devstack sudo[88157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:28 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:26:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] Flow 'volume_create_manager' (7fcf3bee-6c57-4c65-a610-875cc0afa2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:26:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a44b3d-a103-49aa-9cac-bd262b0ef28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:26:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a44b3d-a103-49aa-9cac-bd262b0ef28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1727234578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a981e3-1933-4517-b204-f01101ea69c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='702ff75150a14e39bd77dce218efc46f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:26:28Z,use_quota=True,user_id='769c0737491d45ef864091ea76cfa4a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:26:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f0cc8bc-0138-48d9-a6ac-02b30ba13aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:26:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f0cc8bc-0138-48d9-a6ac-02b30ba13aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:26:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a91593-0d90-4a68-a898-86ef547091d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:26:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a91593-0d90-4a68-a898-86ef547091d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7a981e3-1933-4517-b204-f01101ea69c0', 'volume_name': 'volume-d7a981e3-1933-4517-b204-f01101ea69c0', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:26:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a4f1ba-88be-4f59-9c95-3e43f7c99f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:26:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a4f1ba-88be-4f59-9c95-3e43f7c99f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:26:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (777a3192-0ef2-4d50-93fb-9d4892921b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:26:28 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] Volume d7a981e3-1933-4517-b204-f01101ea69c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7a981e3-1933-4517-b204-f01101ea69c0', 'volume_size': 1} Jun 04 06:26:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:26:28 devstack sudo[88157]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5.info" returned: 0 in 0.910s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:28 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5.info is being set with open permissions: ugo+rw: NotImplementedError Jun 04 06:26:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:28 devstack sudo[88160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5.info Jun 04 06:26:28 devstack sudo[88160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:29 devstack sudo[88160]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5.info" returned: 0 in 0.714s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.843s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:26:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.908s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:26:29 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1727234578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a981e3-1933-4517-b204-f01101ea69c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='702ff75150a14e39bd77dce218efc46f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:26:28Z,use_quota=True,user_id='769c0737491d45ef864091ea76cfa4a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:26:29 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] Creating volume d7a981e3-1933-4517-b204-f01101ea69c0 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:26:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:26:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:26:29 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:26:29 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:26:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:26:29 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:26:29 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:26:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d7a981e3-1933-4517-b204-f01101ea69c0 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:29 devstack sudo[88163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d7a981e3-1933-4517-b204-f01101ea69c0 1073741824 Jun 04 06:26:29 devstack sudo[88163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:29 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-4fc90f09-de99-4ee6-b64d-5453b5f7e0d1 tempest-GroupSnapshotsTest-126993073 None] group_snapshot 01f37fa5-cd12-4b81-b5ee-85b279de7e06: created successfully Jun 04 06:26:30 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] group_snapshot 01f37fa5-cd12-4b81-b5ee-85b279de7e06: deleting Jun 04 06:26:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] group_snapshot 01f37fa5-cd12-4b81-b5ee-85b279de7e06: deleting {{(pid=86069) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Jun 04 06:26:30 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] Acquiring lock "cinder-quobyte-8beeddde-35e4-40cd-b1df-60d73145f997" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:26:30 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] Lock "cinder-quobyte-8beeddde-35e4-40cd-b1df-60d73145f997" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:26:30 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] Acquiring lock "cinder-quobyte-65f714d1-d071-4632-adb9-79b221fc3dcc" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:26:30 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] Lock "cinder-quobyte-65f714d1-d071-4632-adb9-79b221fc3dcc" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:26:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] Deleting offline snapshot 65f714d1-d071-4632-adb9-79b221fc3dcc of volume 8beeddde-35e4-40cd-b1df-60d73145f997 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:26:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] snapshot_file for this snap is: volume-8beeddde-35e4-40cd-b1df-60d73145f997.65f714d1-d071-4632-adb9-79b221fc3dcc {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:26:30 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30a10c2-7b85-49ac-b9fa-56764ab52ab7]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:26:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997.65f714d1-d071-4632-adb9-79b221fc3dcc {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:30 devstack sudo[88163]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d7a981e3-1933-4517-b204-f01101ea69c0 1073741824" returned: 0 in 1.192s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d7a981e3-1933-4517-b204-f01101ea69c0 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:30 devstack sudo[88187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d7a981e3-1933-4517-b204-f01101ea69c0 Jun 04 06:26:30 devstack sudo[88187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:30 devstack sudo[88186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997.65f714d1-d071-4632-adb9-79b221fc3dcc Jun 04 06:26:30 devstack sudo[88186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:31 devstack sudo[88187]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d7a981e3-1933-4517-b204-f01101ea69c0" returned: 0 in 0.750s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:31 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] <== create_volume: return (2014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:26:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.019s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:26:31 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (777a3192-0ef2-4d50-93fb-9d4892921b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7a981e3-1933-4517-b204-f01101ea69c0', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:26:31 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff241565-4dea-4b7f-a6b3-84509ab26b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:26:31 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] Volume volume-d7a981e3-1933-4517-b204-f01101ea69c0 (d7a981e3-1933-4517-b204-f01101ea69c0): created successfully Jun 04 06:26:31 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff241565-4dea-4b7f-a6b3-84509ab26b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:26:31 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] Flow 'volume_create_manager' (7fcf3bee-6c57-4c65-a610-875cc0afa2d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:26:31 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-89c57acf-7521-47db-9ba5-47fdcf0267b9 tempest-AttachVolumeTestJSON-1138902684 None] Created volume successfully. Jun 04 06:26:31 devstack sudo[88186]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997.65f714d1-d071-4632-adb9-79b221fc3dcc" returned: 0 in 0.965s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:31 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8beeddde-35e4-40cd-b1df-60d73145f997(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:26:31 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[62be4203-7a9a-4bd5-97db-bd41b2728abe]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:26:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:31 devstack sudo[88195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997 Jun 04 06:26:31 devstack sudo[88195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:32 devstack sudo[88195]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997" returned: 0 in 0.749s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997.65f714d1-d071-4632-adb9-79b221fc3dcc {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:32 devstack sudo[88200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997.65f714d1-d071-4632-adb9-79b221fc3dcc Jun 04 06:26:32 devstack sudo[88200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:32 devstack sudo[88200]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997.65f714d1-d071-4632-adb9-79b221fc3dcc" returned: 0 in 0.793s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997.65f714d1-d071-4632-adb9-79b221fc3dcc {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:32 devstack sudo[88214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997.65f714d1-d071-4632-adb9-79b221fc3dcc Jun 04 06:26:32 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:33 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997.65f714d1-d071-4632-adb9-79b221fc3dcc" returned: 0 in 0.637s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] Lock "cinder-quobyte-65f714d1-d071-4632-adb9-79b221fc3dcc" released by "_delete_snapshot" :: held 3.295s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:26:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] Lock "cinder-quobyte-8beeddde-35e4-40cd-b1df-60d73145f997" released by "delete_snapshot" :: held 3.327s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:26:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] Acquiring lock "cinder-quobyte-5bb72138-7c58-427e-9f73-0f8ff59cadf5" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:26:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] Lock "cinder-quobyte-5bb72138-7c58-427e-9f73-0f8ff59cadf5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:26:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] Acquiring lock "cinder-quobyte-8c167da1-86c0-49f4-ab9b-9e7195a60aeb" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:26:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] Lock "cinder-quobyte-8c167da1-86c0-49f4-ab9b-9e7195a60aeb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:26:33 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] Deleting offline snapshot 8c167da1-86c0-49f4-ab9b-9e7195a60aeb of volume 5bb72138-7c58-427e-9f73-0f8ff59cadf5 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:26:33 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] snapshot_file for this snap is: volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5.8c167da1-86c0-49f4-ab9b-9e7195a60aeb {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:26:33 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[94eba2fe-dd31-4ff4-9ffb-21184baf9633]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:26:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5.8c167da1-86c0-49f4-ab9b-9e7195a60aeb {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:33 devstack sudo[88221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5.8c167da1-86c0-49f4-ab9b-9e7195a60aeb Jun 04 06:26:33 devstack sudo[88221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:34 devstack sudo[88221]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5.8c167da1-86c0-49f4-ab9b-9e7195a60aeb" returned: 0 in 0.726s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:26:34 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ac5ea8-afd9-4cb6-8418-5b4e0851655f]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:26:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:34 devstack sudo[88227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5 Jun 04 06:26:34 devstack sudo[88227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:35 devstack sudo[88227]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5" returned: 0 in 1.173s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5.8c167da1-86c0-49f4-ab9b-9e7195a60aeb {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:35 devstack sudo[88288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5.8c167da1-86c0-49f4-ab9b-9e7195a60aeb Jun 04 06:26:35 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:36 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5.8c167da1-86c0-49f4-ab9b-9e7195a60aeb" returned: 0 in 0.848s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5.8c167da1-86c0-49f4-ab9b-9e7195a60aeb {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:36 devstack sudo[88300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5.8c167da1-86c0-49f4-ab9b-9e7195a60aeb Jun 04 06:26:36 devstack sudo[88300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:37 devstack sudo[88300]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5.8c167da1-86c0-49f4-ab9b-9e7195a60aeb" returned: 0 in 0.694s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:37 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] Lock "cinder-quobyte-8c167da1-86c0-49f4-ab9b-9e7195a60aeb" released by "_delete_snapshot" :: held 3.567s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:26:37 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] Lock "cinder-quobyte-5bb72138-7c58-427e-9f73-0f8ff59cadf5" released by "delete_snapshot" :: held 3.593s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:26:37 devstack cinder-volume[86069]: WARNING cinder.quota [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-944305197 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-944305197, it is now deprecated. Please use the default quota class for default quota. Jun 04 06:26:37 devstack cinder-volume[86069]: WARNING cinder.quota [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-944305197 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-944305197, it is now deprecated. Please use the default quota class for default quota. Jun 04 06:26:37 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] Created reservations ['f6691c46-e2b7-45e4-b266-5ec6f7dff50a', 'f78cec2b-78c4-4ad8-af74-870b7c6ce383', 'c7fd994b-2ba3-49ff-bdac-f2a14b857e31', '3372c8c8-ec67-4288-b534-00ad13f62531'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:26:37 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] Created reservations ['5f84074d-7e03-440d-a2f5-750ed8bcc8f1', '0e8e0cd2-b5da-4122-aa85-496041b9cd05', '05e51d0c-3efd-408d-9ce0-f799cc1088fb', 'dcbf9412-43a8-4cf9-ab73-9150cb3b290e'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:26:37 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-a8fc1134-35c6-43d3-8695-017fcdda0dfc tempest-GroupSnapshotsTest-126993073 None] group_snapshot 01f37fa5-cd12-4b81-b5ee-85b279de7e06: deleted successfully Jun 04 06:26:38 devstack cinder-volume[86069]: WARNING py.warnings [req-3ef5cc1d-804a-4534-80d9-62925ad93fc7 req-dd78ae89-332f-4243-b380-8f9f51bceb9b tempest-AttachVolumeTestJSON-1138902684 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jun 04 06:26:38 devstack cinder-volume[86069]: .first() Jun 04 06:26:38 devstack cinder-volume[86069]: Jun 04 06:26:38 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-af04bb46-6db0-4db1-ae34-c6d31bd18f56 tempest-GroupSnapshotsTest-126993073 None] Acquiring lock "cinder-quobyte-5bb72138-7c58-427e-9f73-0f8ff59cadf5" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:26:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-3ef5cc1d-804a-4534-80d9-62925ad93fc7 req-dd78ae89-332f-4243-b380-8f9f51bceb9b tempest-AttachVolumeTestJSON-1138902684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:26:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-3ef5cc1d-804a-4534-80d9-62925ad93fc7 req-dd78ae89-332f-4243-b380-8f9f51bceb9b tempest-AttachVolumeTestJSON-1138902684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:26:38 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-af04bb46-6db0-4db1-ae34-c6d31bd18f56 tempest-GroupSnapshotsTest-126993073 None] Lock "cinder-quobyte-5bb72138-7c58-427e-9f73-0f8ff59cadf5" acquired by "delete_volume" :: waited 0.029s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:26:38 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[992f9f7a-174a-428a-a10d-fcfdcda64985]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:26:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-3ef5cc1d-804a-4534-80d9-62925ad93fc7 req-dd78ae89-332f-4243-b380-8f9f51bceb9b tempest-AttachVolumeTestJSON-1138902684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d7a981e3-1933-4517-b204-f01101ea69c0 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:38 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f585a55b-8291-45ae-8f84-9c4d85243bb8]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:26:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-af04bb46-6db0-4db1-ae34-c6d31bd18f56 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:38 devstack sudo[88315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d7a981e3-1933-4517-b204-f01101ea69c0 Jun 04 06:26:38 devstack sudo[88315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:38 devstack sudo[88316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5 Jun 04 06:26:38 devstack sudo[88316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:39 devstack sudo[88316]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-af04bb46-6db0-4db1-ae34-c6d31bd18f56 tempest-GroupSnapshotsTest-126993073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5" returned: 0 in 0.761s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:39 devstack sudo[88315]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-af04bb46-6db0-4db1-ae34-c6d31bd18f56 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-3ef5cc1d-804a-4534-80d9-62925ad93fc7 req-dd78ae89-332f-4243-b380-8f9f51bceb9b tempest-AttachVolumeTestJSON-1138902684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d7a981e3-1933-4517-b204-f01101ea69c0" returned: 0 in 0.793s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-3ef5cc1d-804a-4534-80d9-62925ad93fc7 req-dd78ae89-332f-4243-b380-8f9f51bceb9b tempest-AttachVolumeTestJSON-1138902684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.845s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:26:39 devstack sudo[88325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5 Jun 04 06:26:39 devstack sudo[88325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-3ef5cc1d-804a-4534-80d9-62925ad93fc7 req-dd78ae89-332f-4243-b380-8f9f51bceb9b tempest-AttachVolumeTestJSON-1138902684 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574', 'name': 'volume-d7a981e3-1933-4517-b204-f01101ea69c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8502190d-ace6-4253-a939-02df0125f363', 'enforce_multipath': True} {{(pid=86069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 06:26:39 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-3ef5cc1d-804a-4534-80d9-62925ad93fc7 req-dd78ae89-332f-4243-b380-8f9f51bceb9b tempest-AttachVolumeTestJSON-1138902684 None] attachment_update completed successfully. Jun 04 06:26:39 devstack sudo[88325]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-af04bb46-6db0-4db1-ae34-c6d31bd18f56 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bb72138-7c58-427e-9f73-0f8ff59cadf5" returned: 0 in 0.609s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-af04bb46-6db0-4db1-ae34-c6d31bd18f56 tempest-GroupSnapshotsTest-126993073 None] Lock "cinder-quobyte-5bb72138-7c58-427e-9f73-0f8ff59cadf5" released by "delete_volume" :: held 1.456s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:26:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-af04bb46-6db0-4db1-ae34-c6d31bd18f56 tempest-GroupSnapshotsTest-126993073 None] Acquiring lock "cinder-quobyte-8beeddde-35e4-40cd-b1df-60d73145f997" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:26:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-af04bb46-6db0-4db1-ae34-c6d31bd18f56 tempest-GroupSnapshotsTest-126993073 None] Lock "cinder-quobyte-8beeddde-35e4-40cd-b1df-60d73145f997" acquired by "delete_volume" :: waited 0.018s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:26:39 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f6ae16-b913-40b1-940c-a33295b642c0]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:26:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-af04bb46-6db0-4db1-ae34-c6d31bd18f56 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:39 devstack sudo[88332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997 Jun 04 06:26:39 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:40 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-af04bb46-6db0-4db1-ae34-c6d31bd18f56 tempest-GroupSnapshotsTest-126993073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997" returned: 0 in 0.853s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-af04bb46-6db0-4db1-ae34-c6d31bd18f56 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:40 devstack sudo[88406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997 Jun 04 06:26:40 devstack sudo[88406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:41 devstack sudo[88406]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-af04bb46-6db0-4db1-ae34-c6d31bd18f56 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-8beeddde-35e4-40cd-b1df-60d73145f997" returned: 0 in 0.744s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:41 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-af04bb46-6db0-4db1-ae34-c6d31bd18f56 tempest-GroupSnapshotsTest-126993073 None] Lock "cinder-quobyte-8beeddde-35e4-40cd-b1df-60d73145f997" released by "delete_volume" :: held 1.686s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:26:41 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-af04bb46-6db0-4db1-ae34-c6d31bd18f56 tempest-GroupSnapshotsTest-126993073 None] Created reservations ['c08259c8-05b8-4d66-b230-03d20e7a0f8a'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:26:41 devstack cinder-volume[86069]: WARNING cinder.quota [None req-af04bb46-6db0-4db1-ae34-c6d31bd18f56 tempest-GroupSnapshotsTest-126993073 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-944305197 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-944305197, it is now deprecated. Please use the default quota class for default quota. Jun 04 06:26:41 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-af04bb46-6db0-4db1-ae34-c6d31bd18f56 tempest-GroupSnapshotsTest-126993073 None] Created reservations ['93ee52c9-b503-471d-b896-b38529540f6a', '02d6f336-a7bd-4423-b818-b51b764569bd', '4891ce6a-7ee3-44d3-ad02-9acd607af120', 'be3b6d8a-8112-4a75-906f-3b75df1e7711'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:26:41 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-af04bb46-6db0-4db1-ae34-c6d31bd18f56 tempest-GroupSnapshotsTest-126993073 None] Created reservations ['298cd064-38e8-4cc8-ad1a-d0b25ca03d22', '9738b607-1eba-4023-8314-973ee6338627', 'a60047e4-1af9-42a4-adfa-b0e5495668f7', 'd0fced29-88ef-4937-820c-bbbb18b041ba'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:26:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-af04bb46-6db0-4db1-ae34-c6d31bd18f56 tempest-GroupSnapshotsTest-126993073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:26:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-af04bb46-6db0-4db1-ae34-c6d31bd18f56 tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:26:42 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-af04bb46-6db0-4db1-ae34-c6d31bd18f56 tempest-GroupSnapshotsTest-126993073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:26:42 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-af04bb46-6db0-4db1-ae34-c6d31bd18f56 tempest-GroupSnapshotsTest-126993073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:26:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-af04bb46-6db0-4db1-ae34-c6d31bd18f56 tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:26:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-af04bb46-6db0-4db1-ae34-c6d31bd18f56 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:42 devstack sudo[88728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:26:42 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:42 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-af04bb46-6db0-4db1-ae34-c6d31bd18f56 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.676s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:42 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-af04bb46-6db0-4db1-ae34-c6d31bd18f56 tempest-GroupSnapshotsTest-126993073 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:26:42 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-af04bb46-6db0-4db1-ae34-c6d31bd18f56 tempest-GroupSnapshotsTest-126993073 None] Delete group completed successfully. Jun 04 06:26:43 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-98211970-9dc5-488e-b250-e43f31073b41 tempest-GroupSnapshotsTest-126993073 None] Group tempest-GroupSnapshotsTest-Group-747204109: creating Jun 04 06:26:43 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-98211970-9dc5-488e-b250-e43f31073b41 tempest-GroupSnapshotsTest-126993073 None] Group tempest-GroupSnapshotsTest-Group-747204109: created successfully Jun 04 06:26:43 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-98211970-9dc5-488e-b250-e43f31073b41 tempest-GroupSnapshotsTest-126993073 None] Create group completed successfully. Jun 04 06:26:43 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:26:43 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] Flow 'volume_create_manager' (c39e9078-efc6-41f7-b045-7ce2d75e31bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:26:43 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c6ca6e0-f8f2-4820-9eb0-5e1a0e6bff30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:26:44 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c6ca6e0-f8f2-4820-9eb0-5e1a0e6bff30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1482450530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3a0aea3-d2d4-4e76-a76d-fe2c467c5712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38dc47157e4b45f3aed6a6be80caa7cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:26:44Z,use_quota=True,user_id='ab7d2bfbb62849b8b4c4c7613c5c00ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:26:44 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a070b34-48be-4965-b6b7-83c7431e6d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:26:44 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a070b34-48be-4965-b6b7-83c7431e6d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:26:44 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b57e7e67-fcc1-44c2-ab87-b4be65a2b8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:26:44 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b57e7e67-fcc1-44c2-ab87-b4be65a2b8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3a0aea3-d2d4-4e76-a76d-fe2c467c5712', 'volume_name': 'volume-c3a0aea3-d2d4-4e76-a76d-fe2c467c5712', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:26:44 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83480819-d331-4806-ac9b-63d7c57e6f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:26:44 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83480819-d331-4806-ac9b-63d7c57e6f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:26:44 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41702ac0-9da7-4b3a-b4a1-a53c1997506d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:26:44 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] Volume c3a0aea3-d2d4-4e76-a76d-fe2c467c5712: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3a0aea3-d2d4-4e76-a76d-fe2c467c5712', 'volume_size': 1} Jun 04 06:26:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:26:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:26:44 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1482450530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3a0aea3-d2d4-4e76-a76d-fe2c467c5712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38dc47157e4b45f3aed6a6be80caa7cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:26:44Z,use_quota=True,user_id='ab7d2bfbb62849b8b4c4c7613c5c00ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:26:44 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] Creating volume c3a0aea3-d2d4-4e76-a76d-fe2c467c5712 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:26:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:26:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:26:44 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:26:44 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:26:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:26:44 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:26:44 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:26:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c3a0aea3-d2d4-4e76-a76d-fe2c467c5712 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:44 devstack sudo[88731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c3a0aea3-d2d4-4e76-a76d-fe2c467c5712 1073741824 Jun 04 06:26:44 devstack sudo[88731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:45 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:26:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] Flow 'volume_create_manager' (59838e58-55b9-40c8-b757-68655e4da8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:26:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91830916-8ff1-4e5c-ac62-b260aaa7a0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:26:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91830916-8ff1-4e5c-ac62-b260aaa7a0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2026909387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=60033272-aa7a-4fd5-aead-8d503e7ee0c0,host='devstack@QuobyteHD#QuobyteHD',id=edaf7132-5d6b-4c6f-80c2-99fa8f251453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73173f8b881444eb88d5be8df9142877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:26:45Z,use_quota=True,user_id='2e8bc1dba17540cd8e7a65dd3caa2730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8eaf8ce3-871d-424a-b35b-9240312fcc8e),volume_type_id=8eaf8ce3-871d-424a-b35b-9240312fcc8e)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:26:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61eee726-2af4-4019-9e51-799a434d1e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:26:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61eee726-2af4-4019-9e51-799a434d1e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:26:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef8d27af-40a8-45e2-8b65-43cf5b3ceec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:26:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef8d27af-40a8-45e2-8b65-43cf5b3ceec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edaf7132-5d6b-4c6f-80c2-99fa8f251453', 'volume_name': 'volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:26:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5874036c-0272-4921-9501-7058d595e466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:26:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5874036c-0272-4921-9501-7058d595e466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:26:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a01b0e9-47e7-467b-aa59-07b1ee11cefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:26:45 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] Volume edaf7132-5d6b-4c6f-80c2-99fa8f251453: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453', 'volume_size': 1} Jun 04 06:26:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:26:45 devstack sudo[88731]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c3a0aea3-d2d4-4e76-a76d-fe2c467c5712 1073741824" returned: 0 in 1.325s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c3a0aea3-d2d4-4e76-a76d-fe2c467c5712 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:45 devstack sudo[88736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c3a0aea3-d2d4-4e76-a76d-fe2c467c5712 Jun 04 06:26:45 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:46 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c3a0aea3-d2d4-4e76-a76d-fe2c467c5712" returned: 0 in 1.278s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:46 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] <== create_volume: return (2697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:26:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.701s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:26:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.413s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:26:46 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=60033272-aa7a-4fd5-aead-8d503e7ee0c0,created_at=2026-06-04T04:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2026909387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=60033272-aa7a-4fd5-aead-8d503e7ee0c0,host='devstack@QuobyteHD#QuobyteHD',id=edaf7132-5d6b-4c6f-80c2-99fa8f251453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73173f8b881444eb88d5be8df9142877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:26:45Z,use_quota=True,user_id='2e8bc1dba17540cd8e7a65dd3caa2730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8eaf8ce3-871d-424a-b35b-9240312fcc8e),volume_type_id=8eaf8ce3-871d-424a-b35b-9240312fcc8e)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:26:46 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] Creating volume edaf7132-5d6b-4c6f-80c2-99fa8f251453 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:26:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:26:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:26:46 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:26:46 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:26:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:26:46 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:26:46 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:26:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41702ac0-9da7-4b3a-b4a1-a53c1997506d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3a0aea3-d2d4-4e76-a76d-fe2c467c5712', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:26:46 devstack sudo[88779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453 1073741824 Jun 04 06:26:46 devstack sudo[88779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bcd8f87-80f9-4d4f-b80c-92196db9ca00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:26:46 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] Volume volume-c3a0aea3-d2d4-4e76-a76d-fe2c467c5712 (c3a0aea3-d2d4-4e76-a76d-fe2c467c5712): created successfully Jun 04 06:26:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bcd8f87-80f9-4d4f-b80c-92196db9ca00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:26:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] Flow 'volume_create_manager' (c39e9078-efc6-41f7-b045-7ce2d75e31bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:26:46 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-d4d70a87-3ee3-45af-b234-32e4429282ce tempest-DeleteServersTestJSON-1549830739 None] Created volume successfully. Jun 04 06:26:48 devstack sudo[88779]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453 1073741824" returned: 0 in 1.273s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:48 devstack sudo[88797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453 Jun 04 06:26:48 devstack sudo[88797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:48 devstack sudo[88797]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453" returned: 0 in 0.687s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:48 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] <== create_volume: return (2031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:26:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.036s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:26:48 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a01b0e9-47e7-467b-aa59-07b1ee11cefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:26:48 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (937b77b3-3af2-43e4-bd1a-52ee902e6330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:26:48 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] Volume volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453 (edaf7132-5d6b-4c6f-80c2-99fa8f251453): created successfully Jun 04 06:26:48 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (937b77b3-3af2-43e4-bd1a-52ee902e6330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:26:48 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] Flow 'volume_create_manager' (59838e58-55b9-40c8-b757-68655e4da8c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:26:48 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-a0286ecd-82e2-4687-9b68-c334c93bec9b tempest-GroupSnapshotsTest-126993073 None] Created volume successfully. Jun 04 06:26:50 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-7b9b0728-aa4f-4a82-9c20-5293b93a0160 tempest-GroupSnapshotsTest-126993073 None] GroupSnapshot 509cfc38-6613-4ad4-98a0-58f00246b60e: creating. Jun 04 06:26:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7b9b0728-aa4f-4a82-9c20-5293b93a0160 tempest-GroupSnapshotsTest-126993073 None] Group snapshot 509cfc38-6613-4ad4-98a0-58f00246b60e: creating. {{(pid=86069) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Jun 04 06:26:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7b9b0728-aa4f-4a82-9c20-5293b93a0160 tempest-GroupSnapshotsTest-126993073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:26:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7b9b0728-aa4f-4a82-9c20-5293b93a0160 tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:26:50 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-7b9b0728-aa4f-4a82-9c20-5293b93a0160 tempest-GroupSnapshotsTest-126993073 None] Creating offline snapshot 0a405833-37d2-483d-a931-6f3e8331c3e1 of volume edaf7132-5d6b-4c6f-80c2-99fa8f251453 {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:26:50 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[599c756c-13ee-4901-a3a6-082b6afbb8e2]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:26:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7b9b0728-aa4f-4a82-9c20-5293b93a0160 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:50 devstack sudo[88800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453 Jun 04 06:26:50 devstack sudo[88800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-1d0bba29-a245-436e-9e69-12c5f32ec024 req-ab9d3e6a-5f26-4b55-ae5b-b5e27f2b7185 tempest-DeleteServersTestJSON-1549830739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:26:51 devstack sudo[88800]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7b9b0728-aa4f-4a82-9c20-5293b93a0160 tempest-GroupSnapshotsTest-126993073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453" returned: 0 in 0.964s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7b9b0728-aa4f-4a82-9c20-5293b93a0160 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453.0a405833-37d2-483d-a931-6f3e8331c3e1 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:51 devstack sudo[88813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453.0a405833-37d2-483d-a931-6f3e8331c3e1 1G Jun 04 06:26:51 devstack sudo[88813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:52 devstack sudo[88813]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7b9b0728-aa4f-4a82-9c20-5293b93a0160 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453.0a405833-37d2-483d-a931-6f3e8331c3e1 1G" returned: 0 in 0.785s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7b9b0728-aa4f-4a82-9c20-5293b93a0160 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453.0a405833-37d2-483d-a931-6f3e8331c3e1 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:52 devstack sudo[88827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453.0a405833-37d2-483d-a931-6f3e8331c3e1 Jun 04 06:26:52 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:52 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7b9b0728-aa4f-4a82-9c20-5293b93a0160 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453.0a405833-37d2-483d-a931-6f3e8331c3e1" returned: 0 in 0.662s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:52 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-7b9b0728-aa4f-4a82-9c20-5293b93a0160 tempest-GroupSnapshotsTest-126993073 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453.0a405833-37d2-483d-a931-6f3e8331c3e1 is being set with open permissions: ugo+rw: NotImplementedError Jun 04 06:26:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7b9b0728-aa4f-4a82-9c20-5293b93a0160 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453.0a405833-37d2-483d-a931-6f3e8331c3e1 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:52 devstack sudo[88832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453.0a405833-37d2-483d-a931-6f3e8331c3e1 Jun 04 06:26:52 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:53 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7b9b0728-aa4f-4a82-9c20-5293b93a0160 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453.0a405833-37d2-483d-a931-6f3e8331c3e1" returned: 0 in 0.982s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:53 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=109,cinder:UPDATE=94,cinder:INSERT=25,cinder:DELETE=4 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:26:53 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=93,cinder:INSERT=22,cinder:UPDATE=112,cinder:DELETE=4 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:26:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7b9b0728-aa4f-4a82-9c20-5293b93a0160 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:53 devstack sudo[88951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453.info Jun 04 06:26:53 devstack sudo[88951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:54 devstack sudo[88951]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7b9b0728-aa4f-4a82-9c20-5293b93a0160 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453.info" returned: 0 in 0.965s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:54 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-7b9b0728-aa4f-4a82-9c20-5293b93a0160 tempest-GroupSnapshotsTest-126993073 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453.info is being set with open permissions: ugo+rw: NotImplementedError Jun 04 06:26:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7b9b0728-aa4f-4a82-9c20-5293b93a0160 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:54 devstack sudo[89037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453.info Jun 04 06:26:54 devstack sudo[89037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:55 devstack sudo[89037]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7b9b0728-aa4f-4a82-9c20-5293b93a0160 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453.info" returned: 0 in 0.631s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7b9b0728-aa4f-4a82-9c20-5293b93a0160 tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.203s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:26:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-1d0bba29-a245-436e-9e69-12c5f32ec024 req-ab9d3e6a-5f26-4b55-ae5b-b5e27f2b7185 tempest-DeleteServersTestJSON-1549830739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.549s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:26:55 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6e09b2-3b12-4ff7-8df1-6a99c5625151]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:26:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-1d0bba29-a245-436e-9e69-12c5f32ec024 req-ab9d3e6a-5f26-4b55-ae5b-b5e27f2b7185 tempest-DeleteServersTestJSON-1549830739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c3a0aea3-d2d4-4e76-a76d-fe2c467c5712 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:55 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-7b9b0728-aa4f-4a82-9c20-5293b93a0160 tempest-GroupSnapshotsTest-126993073 None] group_snapshot 509cfc38-6613-4ad4-98a0-58f00246b60e: created successfully Jun 04 06:26:55 devstack sudo[89040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c3a0aea3-d2d4-4e76-a76d-fe2c467c5712 Jun 04 06:26:55 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:55 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-052da04c-3fbc-40cf-b88f-a04030d6c8cc tempest-GroupSnapshotsTest-126993073 None] group_snapshot 509cfc38-6613-4ad4-98a0-58f00246b60e: deleting Jun 04 06:26:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-052da04c-3fbc-40cf-b88f-a04030d6c8cc tempest-GroupSnapshotsTest-126993073 None] group_snapshot 509cfc38-6613-4ad4-98a0-58f00246b60e: deleting {{(pid=86069) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Jun 04 06:26:55 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-052da04c-3fbc-40cf-b88f-a04030d6c8cc tempest-GroupSnapshotsTest-126993073 None] Acquiring lock "cinder-quobyte-edaf7132-5d6b-4c6f-80c2-99fa8f251453" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:26:55 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-052da04c-3fbc-40cf-b88f-a04030d6c8cc tempest-GroupSnapshotsTest-126993073 None] Lock "cinder-quobyte-edaf7132-5d6b-4c6f-80c2-99fa8f251453" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:26:55 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-052da04c-3fbc-40cf-b88f-a04030d6c8cc tempest-GroupSnapshotsTest-126993073 None] Acquiring lock "cinder-quobyte-0a405833-37d2-483d-a931-6f3e8331c3e1" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:26:55 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-052da04c-3fbc-40cf-b88f-a04030d6c8cc tempest-GroupSnapshotsTest-126993073 None] Lock "cinder-quobyte-0a405833-37d2-483d-a931-6f3e8331c3e1" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:26:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-052da04c-3fbc-40cf-b88f-a04030d6c8cc tempest-GroupSnapshotsTest-126993073 None] Deleting offline snapshot 0a405833-37d2-483d-a931-6f3e8331c3e1 of volume edaf7132-5d6b-4c6f-80c2-99fa8f251453 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:26:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-052da04c-3fbc-40cf-b88f-a04030d6c8cc tempest-GroupSnapshotsTest-126993073 None] snapshot_file for this snap is: volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453.0a405833-37d2-483d-a931-6f3e8331c3e1 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:26:56 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6ed119-4018-4ea9-8b41-da8a9c9338ca]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:26:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-052da04c-3fbc-40cf-b88f-a04030d6c8cc tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453.0a405833-37d2-483d-a931-6f3e8331c3e1 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:56 devstack sudo[89043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453.0a405833-37d2-483d-a931-6f3e8331c3e1 Jun 04 06:26:56 devstack sudo[89043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:56 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-1d0bba29-a245-436e-9e69-12c5f32ec024 req-ab9d3e6a-5f26-4b55-ae5b-b5e27f2b7185 tempest-DeleteServersTestJSON-1549830739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c3a0aea3-d2d4-4e76-a76d-fe2c467c5712" returned: 0 in 1.127s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-1d0bba29-a245-436e-9e69-12c5f32ec024 req-ab9d3e6a-5f26-4b55-ae5b-b5e27f2b7185 tempest-DeleteServersTestJSON-1549830739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.156s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:26:56 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-1d0bba29-a245-436e-9e69-12c5f32ec024 req-ab9d3e6a-5f26-4b55-ae5b-b5e27f2b7185 tempest-DeleteServersTestJSON-1549830739 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574', 'name': 'volume-c3a0aea3-d2d4-4e76-a76d-fe2c467c5712', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '72e12629-eb0d-4cb4-9272-f038cf099e30', 'enforce_multipath': True} {{(pid=86069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 06:26:56 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-1d0bba29-a245-436e-9e69-12c5f32ec024 req-ab9d3e6a-5f26-4b55-ae5b-b5e27f2b7185 tempest-DeleteServersTestJSON-1549830739 None] attachment_update completed successfully. Jun 04 06:26:57 devstack sudo[89043]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-052da04c-3fbc-40cf-b88f-a04030d6c8cc tempest-GroupSnapshotsTest-126993073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453.0a405833-37d2-483d-a931-6f3e8331c3e1" returned: 0 in 1.080s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:57 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-052da04c-3fbc-40cf-b88f-a04030d6c8cc tempest-GroupSnapshotsTest-126993073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:26:57 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fe83ab-8bef-4485-aee1-b3ae3e767ef6]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:26:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-052da04c-3fbc-40cf-b88f-a04030d6c8cc tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:57 devstack sudo[89065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453 Jun 04 06:26:57 devstack sudo[89065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:58 devstack sudo[89065]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-052da04c-3fbc-40cf-b88f-a04030d6c8cc tempest-GroupSnapshotsTest-126993073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453" returned: 0 in 1.336s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-052da04c-3fbc-40cf-b88f-a04030d6c8cc tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453.0a405833-37d2-483d-a931-6f3e8331c3e1 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:58 devstack sudo[89442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453.0a405833-37d2-483d-a931-6f3e8331c3e1 Jun 04 06:26:58 devstack sudo[89442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:26:59 devstack sudo[89442]: pam_unix(sudo:session): session closed for user root Jun 04 06:26:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-052da04c-3fbc-40cf-b88f-a04030d6c8cc tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453.0a405833-37d2-483d-a931-6f3e8331c3e1" returned: 0 in 1.360s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:26:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-052da04c-3fbc-40cf-b88f-a04030d6c8cc tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453.0a405833-37d2-483d-a931-6f3e8331c3e1 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:26:59 devstack sudo[89459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453.0a405833-37d2-483d-a931-6f3e8331c3e1 Jun 04 06:26:59 devstack sudo[89459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:00 devstack sudo[89459]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-052da04c-3fbc-40cf-b88f-a04030d6c8cc tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453.0a405833-37d2-483d-a931-6f3e8331c3e1" returned: 0 in 0.807s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:00 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-052da04c-3fbc-40cf-b88f-a04030d6c8cc tempest-GroupSnapshotsTest-126993073 None] Lock "cinder-quobyte-0a405833-37d2-483d-a931-6f3e8331c3e1" released by "_delete_snapshot" :: held 4.804s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:27:00 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-052da04c-3fbc-40cf-b88f-a04030d6c8cc tempest-GroupSnapshotsTest-126993073 None] Lock "cinder-quobyte-edaf7132-5d6b-4c6f-80c2-99fa8f251453" released by "delete_snapshot" :: held 4.864s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:27:00 devstack cinder-volume[86069]: WARNING cinder.quota [None req-052da04c-3fbc-40cf-b88f-a04030d6c8cc tempest-GroupSnapshotsTest-126993073 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-358713829 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-358713829, it is now deprecated. Please use the default quota class for default quota. Jun 04 06:27:00 devstack cinder-volume[86069]: WARNING cinder.quota [None req-052da04c-3fbc-40cf-b88f-a04030d6c8cc tempest-GroupSnapshotsTest-126993073 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-358713829 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-358713829, it is now deprecated. Please use the default quota class for default quota. Jun 04 06:27:00 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-052da04c-3fbc-40cf-b88f-a04030d6c8cc tempest-GroupSnapshotsTest-126993073 None] Created reservations ['4bb1750f-782d-4dbb-921b-3b010e4dbec5', '15d52bd5-233e-41f2-b178-c0bf6ccfa9e4', '0686ae70-4687-4bf9-9af9-e8402008ea4e', '47f8efd5-2260-4cc2-968d-8e5313f112ad'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:27:00 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-052da04c-3fbc-40cf-b88f-a04030d6c8cc tempest-GroupSnapshotsTest-126993073 None] group_snapshot 509cfc38-6613-4ad4-98a0-58f00246b60e: deleted successfully Jun 04 06:27:02 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c7a80abc-dccf-4426-9577-2ba1c158ec22 tempest-GroupSnapshotsTest-126993073 None] Acquiring lock "cinder-quobyte-edaf7132-5d6b-4c6f-80c2-99fa8f251453" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:27:02 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c7a80abc-dccf-4426-9577-2ba1c158ec22 tempest-GroupSnapshotsTest-126993073 None] Lock "cinder-quobyte-edaf7132-5d6b-4c6f-80c2-99fa8f251453" acquired by "delete_volume" :: waited 0.026s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:27:02 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c83813-a5c3-491a-9c14-bb34cbbae9eb]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:27:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c7a80abc-dccf-4426-9577-2ba1c158ec22 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:02 devstack sudo[89469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453 Jun 04 06:27:02 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:03 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c7a80abc-dccf-4426-9577-2ba1c158ec22 tempest-GroupSnapshotsTest-126993073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453" returned: 0 in 1.331s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c7a80abc-dccf-4426-9577-2ba1c158ec22 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:03 devstack sudo[89514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453 Jun 04 06:27:03 devstack sudo[89514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:04 devstack sudo[89514]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c7a80abc-dccf-4426-9577-2ba1c158ec22 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-edaf7132-5d6b-4c6f-80c2-99fa8f251453" returned: 0 in 1.036s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:04 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c7a80abc-dccf-4426-9577-2ba1c158ec22 tempest-GroupSnapshotsTest-126993073 None] Lock "cinder-quobyte-edaf7132-5d6b-4c6f-80c2-99fa8f251453" released by "delete_volume" :: held 2.602s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:27:05 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-c7a80abc-dccf-4426-9577-2ba1c158ec22 tempest-GroupSnapshotsTest-126993073 None] Created reservations ['a1e59315-1367-4b4c-8021-5e89ae5c1f81'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:27:05 devstack cinder-volume[86069]: WARNING cinder.quota [None req-c7a80abc-dccf-4426-9577-2ba1c158ec22 tempest-GroupSnapshotsTest-126993073 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-358713829 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-358713829, it is now deprecated. Please use the default quota class for default quota. Jun 04 06:27:05 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-c7a80abc-dccf-4426-9577-2ba1c158ec22 tempest-GroupSnapshotsTest-126993073 None] Created reservations ['ac8a6da4-cd1c-4e3e-8eb1-279c431ee654', 'a27392da-fc58-4ce6-88cb-cacba5861346', 'b1b2fe75-95df-499b-8d01-7492b7c75417', 'b5af4d74-51b9-4035-a375-da9b7245e232'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:27:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c7a80abc-dccf-4426-9577-2ba1c158ec22 tempest-GroupSnapshotsTest-126993073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:27:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c7a80abc-dccf-4426-9577-2ba1c158ec22 tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:27:05 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c7a80abc-dccf-4426-9577-2ba1c158ec22 tempest-GroupSnapshotsTest-126993073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:27:05 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c7a80abc-dccf-4426-9577-2ba1c158ec22 tempest-GroupSnapshotsTest-126993073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:27:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c7a80abc-dccf-4426-9577-2ba1c158ec22 tempest-GroupSnapshotsTest-126993073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:27:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c7a80abc-dccf-4426-9577-2ba1c158ec22 tempest-GroupSnapshotsTest-126993073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:05 devstack sudo[89561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:27:05 devstack sudo[89561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:06 devstack sudo[89561]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c7a80abc-dccf-4426-9577-2ba1c158ec22 tempest-GroupSnapshotsTest-126993073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.805s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:06 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-c7a80abc-dccf-4426-9577-2ba1c158ec22 tempest-GroupSnapshotsTest-126993073 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:27:06 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-c7a80abc-dccf-4426-9577-2ba1c158ec22 tempest-GroupSnapshotsTest-126993073 None] Delete group completed successfully. Jun 04 06:27:06 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-49cbb6ef-f1bc-466a-9649-1fc0ab14915c req-5b129e08-5799-4402-a82d-f56569114bee tempest-DeleteServersTestJSON-1549830739 None] Terminate volume connection completed successfully. Jun 04 06:27:06 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-49cbb6ef-f1bc-466a-9649-1fc0ab14915c req-5b129e08-5799-4402-a82d-f56569114bee tempest-DeleteServersTestJSON-1549830739 None] Deleting attachment 72e12629-eb0d-4cb4-9272-f038cf099e30. {{(pid=86069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 06:27:10 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-24bc65de-5810-454a-8ef3-d5ca3c462880 tempest-DeleteServersTestJSON-1549830739 None] Acquiring lock "cinder-c3a0aea3-d2d4-4e76-a76d-fe2c467c5712-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:27:11 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-24bc65de-5810-454a-8ef3-d5ca3c462880 tempest-DeleteServersTestJSON-1549830739 None] Lock "cinder-c3a0aea3-d2d4-4e76-a76d-fe2c467c5712-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:27:11 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-24bc65de-5810-454a-8ef3-d5ca3c462880 tempest-DeleteServersTestJSON-1549830739 None] Acquiring lock "cinder-quobyte-c3a0aea3-d2d4-4e76-a76d-fe2c467c5712" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:27:11 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-24bc65de-5810-454a-8ef3-d5ca3c462880 tempest-DeleteServersTestJSON-1549830739 None] Lock "cinder-quobyte-c3a0aea3-d2d4-4e76-a76d-fe2c467c5712" acquired by "delete_volume" :: waited 0.015s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:27:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:27:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:27:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:27:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:27:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:27:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:27:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:11 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e964b0-34e9-4697-a81d-a04f10bf4a69]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:27:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-24bc65de-5810-454a-8ef3-d5ca3c462880 tempest-DeleteServersTestJSON-1549830739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c3a0aea3-d2d4-4e76-a76d-fe2c467c5712 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:11 devstack sudo[89586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:27:11 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:11 devstack sudo[89587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c3a0aea3-d2d4-4e76-a76d-fe2c467c5712 Jun 04 06:27:11 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:11 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-ab3a53b3-c245-471d-89bf-b34f97b18618 tempest-GroupsV314Test-878244956 None] Group tempest-GroupsV314Test-Group-201925397: creating Jun 04 06:27:11 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-ab3a53b3-c245-471d-89bf-b34f97b18618 tempest-GroupsV314Test-878244956 None] Group tempest-GroupsV314Test-Group-201925397: created successfully Jun 04 06:27:11 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-ab3a53b3-c245-471d-89bf-b34f97b18618 tempest-GroupsV314Test-878244956 None] Create group completed successfully. Jun 04 06:27:11 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.888s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:12 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:27:12 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-24bc65de-5810-454a-8ef3-d5ca3c462880 tempest-DeleteServersTestJSON-1549830739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c3a0aea3-d2d4-4e76-a76d-fe2c467c5712" returned: 0 in 0.875s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-24bc65de-5810-454a-8ef3-d5ca3c462880 tempest-DeleteServersTestJSON-1549830739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c3a0aea3-d2d4-4e76-a76d-fe2c467c5712 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:12 devstack sudo[89594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c3a0aea3-d2d4-4e76-a76d-fe2c467c5712 Jun 04 06:27:12 devstack sudo[89594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:12 devstack sudo[89594]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-24bc65de-5810-454a-8ef3-d5ca3c462880 tempest-DeleteServersTestJSON-1549830739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c3a0aea3-d2d4-4e76-a76d-fe2c467c5712" returned: 0 in 0.634s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:12 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-24bc65de-5810-454a-8ef3-d5ca3c462880 tempest-DeleteServersTestJSON-1549830739 None] Lock "cinder-quobyte-c3a0aea3-d2d4-4e76-a76d-fe2c467c5712" released by "delete_volume" :: held 1.590s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:27:12 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-24bc65de-5810-454a-8ef3-d5ca3c462880 tempest-DeleteServersTestJSON-1549830739 None] Created reservations ['66c6545f-4c3c-4cf9-83c5-4ddeeefe66bc', 'b7e3e994-f82a-47ef-a46f-29b780c1adeb', '2910db34-9992-4368-bcc4-7cfee40b11d8', 'd15e300e-be5f-4cbe-b31a-5640bb06a9cf'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:27:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-24bc65de-5810-454a-8ef3-d5ca3c462880 tempest-DeleteServersTestJSON-1549830739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:27:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-24bc65de-5810-454a-8ef3-d5ca3c462880 tempest-DeleteServersTestJSON-1549830739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:27:12 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-24bc65de-5810-454a-8ef3-d5ca3c462880 tempest-DeleteServersTestJSON-1549830739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:27:12 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-24bc65de-5810-454a-8ef3-d5ca3c462880 tempest-DeleteServersTestJSON-1549830739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:27:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-24bc65de-5810-454a-8ef3-d5ca3c462880 tempest-DeleteServersTestJSON-1549830739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:27:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-24bc65de-5810-454a-8ef3-d5ca3c462880 tempest-DeleteServersTestJSON-1549830739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:12 devstack sudo[89609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:27:12 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:13 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-24bc65de-5810-454a-8ef3-d5ca3c462880 tempest-DeleteServersTestJSON-1549830739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.869s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:13 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-24bc65de-5810-454a-8ef3-d5ca3c462880 tempest-DeleteServersTestJSON-1549830739 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:27:13 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:27:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] Flow 'volume_create_manager' (66b4faa2-503a-43a0-af76-50b6c6c4f2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:27:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d896f9bf-2de5-48b7-897d-6156aa13c1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:27:13 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-24bc65de-5810-454a-8ef3-d5ca3c462880 tempest-DeleteServersTestJSON-1549830739 None] Deleted volume successfully. Jun 04 06:27:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d896f9bf-2de5-48b7-897d-6156aa13c1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-828112761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=05642983-8008-41ec-9ef0-6fbca01452a9,host='devstack@QuobyteHD#QuobyteHD',id=ed485a36-5e28-4147-86af-aee58dbfcfcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acd994328d754669ba66fb3f8cc79d8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:27:14Z,use_quota=True,user_id='1af04275d5b8484aa46b1f507114f6ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ad3e8d-fcdd-4637-9140-9650e6a23ce2),volume_type_id=94ad3e8d-fcdd-4637-9140-9650e6a23ce2)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:27:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df286536-0e68-4549-8671-03786d3fff57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:27:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df286536-0e68-4549-8671-03786d3fff57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:27:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c36385e-dbeb-40d1-991b-4b5bc3b14294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:27:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c36385e-dbeb-40d1-991b-4b5bc3b14294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed485a36-5e28-4147-86af-aee58dbfcfcd', 'volume_name': 'volume-ed485a36-5e28-4147-86af-aee58dbfcfcd', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:27:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8622c66b-7681-48b2-9a45-ce504a63dfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:27:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8622c66b-7681-48b2-9a45-ce504a63dfdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:27:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bba7fef-a6ff-45f6-907a-810644910f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:27:13 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] Volume ed485a36-5e28-4147-86af-aee58dbfcfcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed485a36-5e28-4147-86af-aee58dbfcfcd', 'volume_size': 1} Jun 04 06:27:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:27:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:27:13 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=05642983-8008-41ec-9ef0-6fbca01452a9,created_at=2026-06-04T04:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-828112761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=05642983-8008-41ec-9ef0-6fbca01452a9,host='devstack@QuobyteHD#QuobyteHD',id=ed485a36-5e28-4147-86af-aee58dbfcfcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acd994328d754669ba66fb3f8cc79d8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:27:14Z,use_quota=True,user_id='1af04275d5b8484aa46b1f507114f6ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94ad3e8d-fcdd-4637-9140-9650e6a23ce2),volume_type_id=94ad3e8d-fcdd-4637-9140-9650e6a23ce2)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:27:13 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] Creating volume ed485a36-5e28-4147-86af-aee58dbfcfcd {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:27:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:27:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:27:13 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:27:13 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:27:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:27:13 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:27:13 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:27:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:13 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-24bc65de-5810-454a-8ef3-d5ca3c462880 tempest-DeleteServersTestJSON-1549830739 None] Lock "cinder-c3a0aea3-d2d4-4e76-a76d-fe2c467c5712-delete_volume" released by "delete_volume" :: held 2.807s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:27:13 devstack sudo[89612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd 1073741824 Jun 04 06:27:13 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:14 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd 1073741824" returned: 0 in 1.018s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:14 devstack sudo[89646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd Jun 04 06:27:14 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:15 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd" returned: 0 in 0.619s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:15 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:27:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:27:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bba7fef-a6ff-45f6-907a-810644910f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed485a36-5e28-4147-86af-aee58dbfcfcd', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:27:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef2c6b3-046a-4793-b528-737ff99d104b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:27:15 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] Volume volume-ed485a36-5e28-4147-86af-aee58dbfcfcd (ed485a36-5e28-4147-86af-aee58dbfcfcd): created successfully Jun 04 06:27:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef2c6b3-046a-4793-b528-737ff99d104b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:27:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] Flow 'volume_create_manager' (66b4faa2-503a-43a0-af76-50b6c6c4f2a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:27:15 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-74a64478-606b-4258-a376-9451750a7657 tempest-GroupsV314Test-878244956 None] Created volume successfully. Jun 04 06:27:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:27:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:27:17 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Cloning volume ed485a36-5e28-4147-86af-aee58dbfcfcd to volume 2022a418-9a4e-4771-802d-c1b4b7d2f6f2 Jun 04 06:27:17 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Creating offline snapshot 910b005a-0dbd-4cec-b8d1-e6c30bde2543 of volume ed485a36-5e28-4147-86af-aee58dbfcfcd {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:27:17 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[09773965-3b98-4f46-a2d6-8d757504ec64]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:27:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:17 devstack sudo[89651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd Jun 04 06:27:17 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:17 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd" returned: 0 in 0.799s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd.910b005a-0dbd-4cec-b8d1-e6c30bde2543 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:17 devstack sudo[89657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd.910b005a-0dbd-4cec-b8d1-e6c30bde2543 1G Jun 04 06:27:17 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:18 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd.910b005a-0dbd-4cec-b8d1-e6c30bde2543 1G" returned: 0 in 0.882s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed485a36-5e28-4147-86af-aee58dbfcfcd -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd.910b005a-0dbd-4cec-b8d1-e6c30bde2543 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:18 devstack sudo[89663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed485a36-5e28-4147-86af-aee58dbfcfcd -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd.910b005a-0dbd-4cec-b8d1-e6c30bde2543 Jun 04 06:27:18 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:19 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed485a36-5e28-4147-86af-aee58dbfcfcd -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd.910b005a-0dbd-4cec-b8d1-e6c30bde2543" returned: 0 in 0.743s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:19 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd.910b005a-0dbd-4cec-b8d1-e6c30bde2543 is being set with open permissions: ugo+rw: NotImplementedError Jun 04 06:27:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd.910b005a-0dbd-4cec-b8d1-e6c30bde2543 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:19 devstack sudo[89705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd.910b005a-0dbd-4cec-b8d1-e6c30bde2543 Jun 04 06:27:19 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:20 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd.910b005a-0dbd-4cec-b8d1-e6c30bde2543" returned: 0 in 0.648s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:20 devstack sudo[89710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd.info Jun 04 06:27:20 devstack sudo[89710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:20 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:27:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] Flow 'volume_create_manager' (3d4c9433-3f6a-40c3-8023-d4dc567b94a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:27:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56e6964a-661f-41f1-a2d5-6ef2b65e417a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:27:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56e6964a-661f-41f1-a2d5-6ef2b65e417a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1980956297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc72449b-03be-4ca4-83f3-8b01f3933346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bdde5be5eff46e9b943f720e48197c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:27:21Z,use_quota=True,user_id='33c0a4d7c711403b820f5d41828a613c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:27:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4c0af32-64c0-4bb0-b22a-1c3f9489a5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:27:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4c0af32-64c0-4bb0-b22a-1c3f9489a5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:27:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fea42ff-2bed-4d14-9117-86f5ae7cfc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:27:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fea42ff-2bed-4d14-9117-86f5ae7cfc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc72449b-03be-4ca4-83f3-8b01f3933346', 'volume_name': 'volume-dc72449b-03be-4ca4-83f3-8b01f3933346', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:27:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e34f13d9-9a0e-48bb-8129-2961a182b496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:27:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e34f13d9-9a0e-48bb-8129-2961a182b496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:27:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb9305fb-f91d-4cb9-a3e9-ba2181912355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:27:20 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] Volume dc72449b-03be-4ca4-83f3-8b01f3933346: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc72449b-03be-4ca4-83f3-8b01f3933346', 'volume_size': 1} Jun 04 06:27:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:27:21 devstack sudo[89710]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd.info" returned: 0 in 0.838s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:21 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd.info is being set with open permissions: ugo+rw: NotImplementedError Jun 04 06:27:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:21 devstack sudo[89713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd.info Jun 04 06:27:21 devstack sudo[89713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:21 devstack sudo[89713]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd.info" returned: 0 in 0.651s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:21 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Acquiring lock "cinder-quobyte-2022a418-9a4e-4771-802d-c1b4b7d2f6f2" by "_copy_volume_from_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:27:21 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Lock "cinder-quobyte-2022a418-9a4e-4771-802d-c1b4b7d2f6f2" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:27:21 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] snapshot: 910b005a-0dbd-4cec-b8d1-e6c30bde2543, volume: 2022a418-9a4e-4771-802d-c1b4b7d2f6f2, {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 06:27:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:27:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:27:21 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:27:21 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:27:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:27:21 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[d462b585-1a95-455d-be26-b71c18b929ee]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:27:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd.910b005a-0dbd-4cec-b8d1-e6c30bde2543 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:21 devstack sudo[89716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd.910b005a-0dbd-4cec-b8d1-e6c30bde2543 Jun 04 06:27:21 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:22 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd.910b005a-0dbd-4cec-b8d1-e6c30bde2543" returned: 0 in 0.760s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:22 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed485a36-5e28-4147-86af-aee58dbfcfcd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:27:22 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 06:27:22 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Creating direct copy from snapshot {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 06:27:22 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa5cbc3-ef31-4151-a53f-4766c436eba0]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:27:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:22 devstack sudo[89723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd Jun 04 06:27:22 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:23 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd" returned: 0 in 0.788s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:23 devstack cinder-volume[86069]: DEBUG cinder.utils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Path /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2022a418-9a4e-4771-802d-c1b4b7d2f6f2 not found in is_blk_device check {{(pid=86069) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 04 06:27:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2022a418-9a4e-4771-802d-c1b4b7d2f6f2 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:23 devstack sudo[89729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2022a418-9a4e-4771-802d-c1b4b7d2f6f2 Jun 04 06:27:23 devstack sudo[89729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:24 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-e3d86f48-89bf-4fb8-8c8f-8886ae0e2c39 req-953508cf-bfd9-46d6-8680-774707d54d95 tempest-AttachVolumeTestJSON-1138902684 None] Terminate volume connection completed successfully. Jun 04 06:27:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-e3d86f48-89bf-4fb8-8c8f-8886ae0e2c39 req-953508cf-bfd9-46d6-8680-774707d54d95 tempest-AttachVolumeTestJSON-1138902684 None] Deleting attachment 8502190d-ace6-4253-a939-02df0125f363. {{(pid=86069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 06:27:29 devstack sudo[89729]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2022a418-9a4e-4771-802d-c1b4b7d2f6f2" returned: 0 in 6.432s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:29 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f591334e-7c5b-4325-8d48-e67762eef0ed]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:27:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:29 devstack sudo[89783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd Jun 04 06:27:29 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:30 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=39,cinder:UPDATE=39,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:27:31 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd" returned: 0 in 1.407s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:31 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Image conversion details: src /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd, size 1024.00 MB, duration 6.43 sec, destination /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2022a418-9a4e-4771-802d-c1b4b7d2f6f2 {{(pid=86069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 06:27:31 devstack cinder-volume[86069]: INFO cinder.image.image_utils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Converted 1024.00 MB image at 159.16 MB/s Jun 04 06:27:31 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2022a418-9a4e-4771-802d-c1b4b7d2f6f2 is being set with open permissions: ugo+rw: NotImplementedError Jun 04 06:27:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2022a418-9a4e-4771-802d-c1b4b7d2f6f2 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:31 devstack sudo[89789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2022a418-9a4e-4771-802d-c1b4b7d2f6f2 Jun 04 06:27:31 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:31 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2022a418-9a4e-4771-802d-c1b4b7d2f6f2" returned: 0 in 0.693s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:31 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Lock "cinder-quobyte-2022a418-9a4e-4771-802d-c1b4b7d2f6f2" released by "_copy_volume_from_snapshot" :: held 10.205s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:27:31 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Acquiring lock "cinder-quobyte-910b005a-0dbd-4cec-b8d1-e6c30bde2543" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:27:32 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Lock "cinder-quobyte-910b005a-0dbd-4cec-b8d1-e6c30bde2543" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:27:32 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Deleting offline snapshot 910b005a-0dbd-4cec-b8d1-e6c30bde2543 of volume ed485a36-5e28-4147-86af-aee58dbfcfcd {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:27:32 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] snapshot_file for this snap is: volume-ed485a36-5e28-4147-86af-aee58dbfcfcd.910b005a-0dbd-4cec-b8d1-e6c30bde2543 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:27:32 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eba5a3c-0433-44da-b757-b618b773be33]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:27:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd.910b005a-0dbd-4cec-b8d1-e6c30bde2543 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:32 devstack sudo[89792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd.910b005a-0dbd-4cec-b8d1-e6c30bde2543 Jun 04 06:27:32 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:33 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd.910b005a-0dbd-4cec-b8d1-e6c30bde2543" returned: 0 in 1.281s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:33 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed485a36-5e28-4147-86af-aee58dbfcfcd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:27:33 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[00866b6c-dc2e-4903-b7d4-ec5b05409b9a]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:27:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:33 devstack sudo[89804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd Jun 04 06:27:33 devstack sudo[89804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:34 devstack sudo[89804]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd" returned: 0 in 0.859s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd.910b005a-0dbd-4cec-b8d1-e6c30bde2543 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:34 devstack sudo[89809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd.910b005a-0dbd-4cec-b8d1-e6c30bde2543 Jun 04 06:27:34 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:35 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd.910b005a-0dbd-4cec-b8d1-e6c30bde2543" returned: 0 in 0.788s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd.910b005a-0dbd-4cec-b8d1-e6c30bde2543 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:35 devstack sudo[89815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd.910b005a-0dbd-4cec-b8d1-e6c30bde2543 Jun 04 06:27:35 devstack sudo[89815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:35 devstack sudo[89815]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd.910b005a-0dbd-4cec-b8d1-e6c30bde2543" returned: 0 in 0.683s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:35 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Lock "cinder-quobyte-910b005a-0dbd-4cec-b8d1-e6c30bde2543" released by "_delete_snapshot" :: held 3.802s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:27:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.808s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:27:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.923s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:27:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1980956297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc72449b-03be-4ca4-83f3-8b01f3933346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bdde5be5eff46e9b943f720e48197c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:27:21Z,use_quota=True,user_id='33c0a4d7c711403b820f5d41828a613c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:27:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] Creating volume dc72449b-03be-4ca4-83f3-8b01f3933346 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:27:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:27:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:27:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:27:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:27:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:27:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:27:35 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:27:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dc72449b-03be-4ca4-83f3-8b01f3933346 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:35 devstack sudo[89818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dc72449b-03be-4ca4-83f3-8b01f3933346 1073741824 Jun 04 06:27:35 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:35 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-52f5bf9b-f90a-47ab-9ba2-5df0868ff9b7 tempest-GroupsV314Test-878244956 None] Create group from source-group-05642983-8008-41ec-9ef0-6fbca01452a9 completed successfully. Jun 04 06:27:36 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dc72449b-03be-4ca4-83f3-8b01f3933346 1073741824" returned: 0 in 0.940s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dc72449b-03be-4ca4-83f3-8b01f3933346 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:36 devstack sudo[89825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dc72449b-03be-4ca4-83f3-8b01f3933346 Jun 04 06:27:36 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:37 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7adcd776-1397-475f-af94-2b493ea6ea34 tempest-GroupsV314Test-878244956 None] Acquiring lock "cinder-quobyte-2022a418-9a4e-4771-802d-c1b4b7d2f6f2" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:27:37 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7adcd776-1397-475f-af94-2b493ea6ea34 tempest-GroupsV314Test-878244956 None] Lock "cinder-quobyte-2022a418-9a4e-4771-802d-c1b4b7d2f6f2" acquired by "delete_volume" :: waited 0.032s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:27:37 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[8161dfef-d70f-4f81-9d96-51f603dbac12]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:27:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7adcd776-1397-475f-af94-2b493ea6ea34 tempest-GroupsV314Test-878244956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2022a418-9a4e-4771-802d-c1b4b7d2f6f2 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:37 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dc72449b-03be-4ca4-83f3-8b01f3933346" returned: 0 in 0.712s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:37 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:27:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:27:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb9305fb-f91d-4cb9-a3e9-ba2181912355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc72449b-03be-4ca4-83f3-8b01f3933346', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:27:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae206a7d-9d87-4383-a6a2-2f6a7c1d0726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:27:37 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] Volume volume-dc72449b-03be-4ca4-83f3-8b01f3933346 (dc72449b-03be-4ca4-83f3-8b01f3933346): created successfully Jun 04 06:27:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae206a7d-9d87-4383-a6a2-2f6a7c1d0726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:27:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] Flow 'volume_create_manager' (3d4c9433-3f6a-40c3-8023-d4dc567b94a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:27:37 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-0a978672-8fdf-4161-8c17-5dff97a073ce tempest-AttachVolumeNegativeTest-499422654 None] Created volume successfully. Jun 04 06:27:37 devstack sudo[89829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2022a418-9a4e-4771-802d-c1b4b7d2f6f2 Jun 04 06:27:37 devstack sudo[89829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:38 devstack sudo[89829]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7adcd776-1397-475f-af94-2b493ea6ea34 tempest-GroupsV314Test-878244956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2022a418-9a4e-4771-802d-c1b4b7d2f6f2" returned: 0 in 0.870s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7adcd776-1397-475f-af94-2b493ea6ea34 tempest-GroupsV314Test-878244956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2022a418-9a4e-4771-802d-c1b4b7d2f6f2 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:38 devstack sudo[89841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2022a418-9a4e-4771-802d-c1b4b7d2f6f2 Jun 04 06:27:38 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:39 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7adcd776-1397-475f-af94-2b493ea6ea34 tempest-GroupsV314Test-878244956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2022a418-9a4e-4771-802d-c1b4b7d2f6f2" returned: 0 in 0.695s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7adcd776-1397-475f-af94-2b493ea6ea34 tempest-GroupsV314Test-878244956 None] Lock "cinder-quobyte-2022a418-9a4e-4771-802d-c1b4b7d2f6f2" released by "delete_volume" :: held 1.639s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:27:39 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-7adcd776-1397-475f-af94-2b493ea6ea34 tempest-GroupsV314Test-878244956 None] Created reservations ['a2b6fe7f-0dc5-4c53-8566-a26bab85d4ba'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:27:39 devstack cinder-volume[86069]: WARNING cinder.quota [None req-7adcd776-1397-475f-af94-2b493ea6ea34 tempest-GroupsV314Test-878244956 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1003867311 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1003867311, it is now deprecated. Please use the default quota class for default quota. Jun 04 06:27:39 devstack cinder-volume[86069]: WARNING cinder.quota [None req-7adcd776-1397-475f-af94-2b493ea6ea34 tempest-GroupsV314Test-878244956 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1003867311 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1003867311, it is now deprecated. Please use the default quota class for default quota. Jun 04 06:27:39 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-7adcd776-1397-475f-af94-2b493ea6ea34 tempest-GroupsV314Test-878244956 None] Created reservations ['ae0ee233-bc52-43af-925c-68cd1aa72189', '7cf8ac59-1613-47fe-a660-43358cebf6ce', '1dd5a9db-2c9b-4fb8-bfc8-2a3ffeaa97e3', '708b5589-778a-468b-abe4-fc189c684a2d'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:27:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7adcd776-1397-475f-af94-2b493ea6ea34 tempest-GroupsV314Test-878244956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:27:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7adcd776-1397-475f-af94-2b493ea6ea34 tempest-GroupsV314Test-878244956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:27:39 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7adcd776-1397-475f-af94-2b493ea6ea34 tempest-GroupsV314Test-878244956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:27:39 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7adcd776-1397-475f-af94-2b493ea6ea34 tempest-GroupsV314Test-878244956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:27:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7adcd776-1397-475f-af94-2b493ea6ea34 tempest-GroupsV314Test-878244956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:27:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7adcd776-1397-475f-af94-2b493ea6ea34 tempest-GroupsV314Test-878244956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:39 devstack sudo[89850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:27:39 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:40 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-8cc23160-7936-4503-97ce-d67b4183ce3b tempest-GroupsV314Test-878244956 None] Acquiring lock "cinder-quobyte-ed485a36-5e28-4147-86af-aee58dbfcfcd" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:27:40 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-8cc23160-7936-4503-97ce-d67b4183ce3b tempest-GroupsV314Test-878244956 None] Lock "cinder-quobyte-ed485a36-5e28-4147-86af-aee58dbfcfcd" acquired by "delete_volume" :: waited 0.029s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:27:40 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[4847fc65-5f06-4f11-bd10-871fc5e87efa]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:27:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8cc23160-7936-4503-97ce-d67b4183ce3b tempest-GroupsV314Test-878244956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:40 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7adcd776-1397-475f-af94-2b493ea6ea34 tempest-GroupsV314Test-878244956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.224s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:40 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-7adcd776-1397-475f-af94-2b493ea6ea34 tempest-GroupsV314Test-878244956 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:27:40 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-7adcd776-1397-475f-af94-2b493ea6ea34 tempest-GroupsV314Test-878244956 None] Delete group completed successfully. Jun 04 06:27:40 devstack sudo[89908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd Jun 04 06:27:40 devstack sudo[89908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:41 devstack sudo[89908]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8cc23160-7936-4503-97ce-d67b4183ce3b tempest-GroupsV314Test-878244956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd" returned: 0 in 1.386s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8cc23160-7936-4503-97ce-d67b4183ce3b tempest-GroupsV314Test-878244956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:41 devstack sudo[89925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd Jun 04 06:27:41 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:43 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8cc23160-7936-4503-97ce-d67b4183ce3b tempest-GroupsV314Test-878244956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ed485a36-5e28-4147-86af-aee58dbfcfcd" returned: 0 in 1.167s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:43 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-8cc23160-7936-4503-97ce-d67b4183ce3b tempest-GroupsV314Test-878244956 None] Lock "cinder-quobyte-ed485a36-5e28-4147-86af-aee58dbfcfcd" released by "delete_volume" :: held 2.696s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:27:43 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-8cc23160-7936-4503-97ce-d67b4183ce3b tempest-GroupsV314Test-878244956 None] Created reservations ['8ebe5b42-015b-4222-981c-252b172d24a8'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:27:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-d445eb86-7a3b-4602-92fc-928bcdb59389 req-3e81fabb-e989-45fe-b475-e77f7a56d044 tempest-AttachVolumeNegativeTest-499422654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:27:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-d445eb86-7a3b-4602-92fc-928bcdb59389 req-3e81fabb-e989-45fe-b475-e77f7a56d044 tempest-AttachVolumeNegativeTest-499422654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:27:43 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a394c3-2a25-409a-bc4f-68b887bf3c53]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:27:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-d445eb86-7a3b-4602-92fc-928bcdb59389 req-3e81fabb-e989-45fe-b475-e77f7a56d044 tempest-AttachVolumeNegativeTest-499422654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dc72449b-03be-4ca4-83f3-8b01f3933346 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:43 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-8cc23160-7936-4503-97ce-d67b4183ce3b tempest-GroupsV314Test-878244956 None] Created reservations ['f7b7b229-5464-46be-a64e-206fb2b9944c', '8bcd9954-1909-445d-8a02-80a0ed4c0605', '18c81225-128b-44c1-891d-ce158fcb6f1b', '33a4d8f0-25de-4919-bc67-ec8eecc98a3e'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:27:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8cc23160-7936-4503-97ce-d67b4183ce3b tempest-GroupsV314Test-878244956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:27:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8cc23160-7936-4503-97ce-d67b4183ce3b tempest-GroupsV314Test-878244956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:27:43 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-8cc23160-7936-4503-97ce-d67b4183ce3b tempest-GroupsV314Test-878244956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:27:43 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-8cc23160-7936-4503-97ce-d67b4183ce3b tempest-GroupsV314Test-878244956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:27:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8cc23160-7936-4503-97ce-d67b4183ce3b tempest-GroupsV314Test-878244956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:27:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8cc23160-7936-4503-97ce-d67b4183ce3b tempest-GroupsV314Test-878244956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:43 devstack sudo[89937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dc72449b-03be-4ca4-83f3-8b01f3933346 Jun 04 06:27:43 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:43 devstack sudo[89938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:27:43 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:44 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8cc23160-7936-4503-97ce-d67b4183ce3b tempest-GroupsV314Test-878244956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.917s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:44 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-8cc23160-7936-4503-97ce-d67b4183ce3b tempest-GroupsV314Test-878244956 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:27:44 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-8cc23160-7936-4503-97ce-d67b4183ce3b tempest-GroupsV314Test-878244956 None] Delete group completed successfully. Jun 04 06:27:44 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-d445eb86-7a3b-4602-92fc-928bcdb59389 req-3e81fabb-e989-45fe-b475-e77f7a56d044 tempest-AttachVolumeNegativeTest-499422654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dc72449b-03be-4ca4-83f3-8b01f3933346" returned: 0 in 1.711s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-d445eb86-7a3b-4602-92fc-928bcdb59389 req-3e81fabb-e989-45fe-b475-e77f7a56d044 tempest-AttachVolumeNegativeTest-499422654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.742s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:27:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-d445eb86-7a3b-4602-92fc-928bcdb59389 req-3e81fabb-e989-45fe-b475-e77f7a56d044 tempest-AttachVolumeNegativeTest-499422654 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574', 'name': 'volume-dc72449b-03be-4ca4-83f3-8b01f3933346', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b1bebf63-045f-4ba9-a02b-c9bfc6b94186', 'enforce_multipath': True} {{(pid=86069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 06:27:45 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-d445eb86-7a3b-4602-92fc-928bcdb59389 req-3e81fabb-e989-45fe-b475-e77f7a56d044 tempest-AttachVolumeNegativeTest-499422654 None] attachment_update completed successfully. Jun 04 06:27:51 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:27:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] Flow 'volume_create_manager' (e757e563-32de-4fec-8f25-8dfe8d58806e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:27:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b613bdeb-06cc-4202-b589-aa65e0c38929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:27:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b613bdeb-06cc-4202-b589-aa65e0c38929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-337311359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fcc457b-2c91-4254-85e2-d36be222bd20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769a77ca1c974ce2a78599757063f036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:27:51Z,use_quota=True,user_id='4305e1c91f80419fb3ea2c5681cb7dd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:27:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20d393cb-2b54-4a5a-a3bb-1e18f5f88efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:27:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20d393cb-2b54-4a5a-a3bb-1e18f5f88efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:27:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e5e76a9-70a0-45bc-809f-e4719cd89c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:27:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e5e76a9-70a0-45bc-809f-e4719cd89c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fcc457b-2c91-4254-85e2-d36be222bd20', 'volume_name': 'volume-9fcc457b-2c91-4254-85e2-d36be222bd20', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:27:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a31634e6-f6ea-4467-984d-7c977515de40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:27:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a31634e6-f6ea-4467-984d-7c977515de40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:27:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e3d528b-f741-4913-863c-0e464384a794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:27:51 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] Volume 9fcc457b-2c91-4254-85e2-d36be222bd20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fcc457b-2c91-4254-85e2-d36be222bd20', 'volume_size': 1} Jun 04 06:27:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:27:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:27:51 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-337311359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fcc457b-2c91-4254-85e2-d36be222bd20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769a77ca1c974ce2a78599757063f036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:27:51Z,use_quota=True,user_id='4305e1c91f80419fb3ea2c5681cb7dd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:27:51 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] Creating volume 9fcc457b-2c91-4254-85e2-d36be222bd20 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:27:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:27:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:27:51 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:27:51 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:27:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:27:51 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:27:51 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:27:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9fcc457b-2c91-4254-85e2-d36be222bd20 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:51 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9fcc457b-2c91-4254-85e2-d36be222bd20 1073741824 Jun 04 06:27:51 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:52 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9fcc457b-2c91-4254-85e2-d36be222bd20 1073741824" returned: 0 in 1.112s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9fcc457b-2c91-4254-85e2-d36be222bd20 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:27:52 devstack sudo[90336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9fcc457b-2c91-4254-85e2-d36be222bd20 Jun 04 06:27:52 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:27:53 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root Jun 04 06:27:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9fcc457b-2c91-4254-85e2-d36be222bd20" returned: 0 in 0.852s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:27:53 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] <== create_volume: return (2028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:27:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.032s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:27:53 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e3d528b-f741-4913-863c-0e464384a794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fcc457b-2c91-4254-85e2-d36be222bd20', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:27:53 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b61184-7d1a-4ba2-853a-8e31c802d179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:27:53 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] Volume volume-9fcc457b-2c91-4254-85e2-d36be222bd20 (9fcc457b-2c91-4254-85e2-d36be222bd20): created successfully Jun 04 06:27:53 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b61184-7d1a-4ba2-853a-8e31c802d179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:27:53 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] Flow 'volume_create_manager' (e757e563-32de-4fec-8f25-8dfe8d58806e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:27:53 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-ecde2351-6e9f-4ecc-9e4b-8f9309a5fd8e tempest-TaggedAttachmentsTest-1196106279 None] Created volume successfully. Jun 04 06:28:03 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=78,cinder:INSERT=19,cinder:UPDATE=53,cinder:DELETE=1 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:28:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:28:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:28:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:28:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:28:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:28:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:28:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:28:11 devstack sudo[90531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:28:11 devstack sudo[90531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:28:12 devstack sudo[90531]: pam_unix(sudo:session): session closed for user root Jun 04 06:28:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.560s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:28:12 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:28:12 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager._thread_info {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:28:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread count: 8 {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 06:28:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread info: [<_MainThread(MainThread, started 131797370544256)>, , , , , , , ] {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 06:28:13 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:UPDATE=38,cinder:SELECT=23,cinder:DELETE=2,cinder:INSERT=7 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:28:27 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:28:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] Flow 'volume_create_manager' (9cc5ec8f-ed87-4e63-b884-ba2da1effbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:28:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02432858-c63e-4bc7-8865-d2a2444d9c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:28:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02432858-c63e-4bc7-8865-d2a2444d9c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1114534304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca686e09-19c9-4ed1-8858-d016e4d1cc4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='343739bd4a364e24b2311ea2cb1bd632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:28:27Z,use_quota=True,user_id='d1e55bcb42934559921e0911daa82ee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:28:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (633b49ec-ad02-4812-acfc-27585add0e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:28:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (633b49ec-ad02-4812-acfc-27585add0e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:28:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (960640be-d706-4a3b-963b-fc638ffed431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:28:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (960640be-d706-4a3b-963b-fc638ffed431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca686e09-19c9-4ed1-8858-d016e4d1cc4a', 'volume_name': 'volume-ca686e09-19c9-4ed1-8858-d016e4d1cc4a', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:28:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (188d1b68-fbe8-43a4-9608-49cc06253d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:28:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (188d1b68-fbe8-43a4-9608-49cc06253d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:28:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87897f5d-8579-4da3-a062-751b950400b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:28:27 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] Volume ca686e09-19c9-4ed1-8858-d016e4d1cc4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca686e09-19c9-4ed1-8858-d016e4d1cc4a', 'volume_size': 1} Jun 04 06:28:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:28:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:28:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1114534304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca686e09-19c9-4ed1-8858-d016e4d1cc4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='343739bd4a364e24b2311ea2cb1bd632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:28:27Z,use_quota=True,user_id='d1e55bcb42934559921e0911daa82ee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:28:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] Creating volume ca686e09-19c9-4ed1-8858-d016e4d1cc4a {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:28:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:28:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:28:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:28:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:28:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:28:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:28:27 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:28:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ca686e09-19c9-4ed1-8858-d016e4d1cc4a 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:28:27 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ca686e09-19c9-4ed1-8858-d016e4d1cc4a 1073741824 Jun 04 06:28:27 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:28:28 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Jun 04 06:28:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ca686e09-19c9-4ed1-8858-d016e4d1cc4a 1073741824" returned: 0 in 1.064s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:28:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ca686e09-19c9-4ed1-8858-d016e4d1cc4a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:28:28 devstack sudo[90698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ca686e09-19c9-4ed1-8858-d016e4d1cc4a Jun 04 06:28:28 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:28:29 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root Jun 04 06:28:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ca686e09-19c9-4ed1-8858-d016e4d1cc4a" returned: 0 in 0.684s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:28:29 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] <== create_volume: return (1801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:28:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.804s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:28:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87897f5d-8579-4da3-a062-751b950400b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca686e09-19c9-4ed1-8858-d016e4d1cc4a', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:28:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bb16a73-0413-469c-97f0-a28f85a42f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:28:29 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] Volume volume-ca686e09-19c9-4ed1-8858-d016e4d1cc4a (ca686e09-19c9-4ed1-8858-d016e4d1cc4a): created successfully Jun 04 06:28:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bb16a73-0413-469c-97f0-a28f85a42f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:28:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] Flow 'volume_create_manager' (9cc5ec8f-ed87-4e63-b884-ba2da1effbc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:28:29 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-43fd5ea2-8f35-4a7b-a3be-2347a9460373 tempest-VolumesMetadataTest-1617380624 None] Created volume successfully. Jun 04 06:28:29 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ca1b6fab-f830-4880-bf4a-424232d97ec4 tempest-VolumesMetadataTest-1617380624 None] Acquiring lock "cinder-ca686e09-19c9-4ed1-8858-d016e4d1cc4a-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:28:29 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ca1b6fab-f830-4880-bf4a-424232d97ec4 tempest-VolumesMetadataTest-1617380624 None] Lock "cinder-ca686e09-19c9-4ed1-8858-d016e4d1cc4a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:28:30 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ca1b6fab-f830-4880-bf4a-424232d97ec4 tempest-VolumesMetadataTest-1617380624 None] Acquiring lock "cinder-quobyte-ca686e09-19c9-4ed1-8858-d016e4d1cc4a" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:28:30 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ca1b6fab-f830-4880-bf4a-424232d97ec4 tempest-VolumesMetadataTest-1617380624 None] Lock "cinder-quobyte-ca686e09-19c9-4ed1-8858-d016e4d1cc4a" acquired by "delete_volume" :: waited 0.017s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:28:30 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5dc9761-3763-407b-8772-707a5641fd02]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:28:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ca1b6fab-f830-4880-bf4a-424232d97ec4 tempest-VolumesMetadataTest-1617380624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ca686e09-19c9-4ed1-8858-d016e4d1cc4a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:28:30 devstack sudo[90711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ca686e09-19c9-4ed1-8858-d016e4d1cc4a Jun 04 06:28:30 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:28:30 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root Jun 04 06:28:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ca1b6fab-f830-4880-bf4a-424232d97ec4 tempest-VolumesMetadataTest-1617380624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ca686e09-19c9-4ed1-8858-d016e4d1cc4a" returned: 0 in 0.714s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:28:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ca1b6fab-f830-4880-bf4a-424232d97ec4 tempest-VolumesMetadataTest-1617380624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ca686e09-19c9-4ed1-8858-d016e4d1cc4a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:28:30 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ca686e09-19c9-4ed1-8858-d016e4d1cc4a Jun 04 06:28:30 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:28:31 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Jun 04 06:28:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ca1b6fab-f830-4880-bf4a-424232d97ec4 tempest-VolumesMetadataTest-1617380624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ca686e09-19c9-4ed1-8858-d016e4d1cc4a" returned: 0 in 0.657s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:28:31 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ca1b6fab-f830-4880-bf4a-424232d97ec4 tempest-VolumesMetadataTest-1617380624 None] Lock "cinder-quobyte-ca686e09-19c9-4ed1-8858-d016e4d1cc4a" released by "delete_volume" :: held 1.411s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:28:31 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-ca1b6fab-f830-4880-bf4a-424232d97ec4 tempest-VolumesMetadataTest-1617380624 None] Created reservations ['96853a41-31fa-4f7d-8e72-e8d5eefb334a', 'c10544bf-47bd-4d71-b238-60d0424b6a3b', 'd77c9cc0-06bc-40c7-b350-f3dfc27bf458', '9d2834f3-2da0-457e-b634-097e3c064e11'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:28:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ca1b6fab-f830-4880-bf4a-424232d97ec4 tempest-VolumesMetadataTest-1617380624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:28:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ca1b6fab-f830-4880-bf4a-424232d97ec4 tempest-VolumesMetadataTest-1617380624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:28:31 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ca1b6fab-f830-4880-bf4a-424232d97ec4 tempest-VolumesMetadataTest-1617380624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:28:31 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ca1b6fab-f830-4880-bf4a-424232d97ec4 tempest-VolumesMetadataTest-1617380624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:28:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ca1b6fab-f830-4880-bf4a-424232d97ec4 tempest-VolumesMetadataTest-1617380624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:28:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ca1b6fab-f830-4880-bf4a-424232d97ec4 tempest-VolumesMetadataTest-1617380624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:28:31 devstack sudo[90719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:28:31 devstack sudo[90719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:28:32 devstack sudo[90719]: pam_unix(sudo:session): session closed for user root Jun 04 06:28:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ca1b6fab-f830-4880-bf4a-424232d97ec4 tempest-VolumesMetadataTest-1617380624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.634s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:28:32 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-ca1b6fab-f830-4880-bf4a-424232d97ec4 tempest-VolumesMetadataTest-1617380624 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:28:32 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-ca1b6fab-f830-4880-bf4a-424232d97ec4 tempest-VolumesMetadataTest-1617380624 None] Deleted volume successfully. Jun 04 06:28:32 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ca1b6fab-f830-4880-bf4a-424232d97ec4 tempest-VolumesMetadataTest-1617380624 None] Lock "cinder-ca686e09-19c9-4ed1-8858-d016e4d1cc4a-delete_volume" released by "delete_volume" :: held 2.259s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:28:37 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:28:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] Flow 'volume_create_manager' (0a9f516a-5139-4612-96d8-102faca0a880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:28:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e45bea8-bcc2-4444-871f-87835d9068a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:28:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e45bea8-bcc2-4444-871f-87835d9068a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1667336429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1624ce24-8eb3-4a61-8aa5-b82d7eade20b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789559eba9ce40bea747778105f8afdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:28:38Z,use_quota=True,user_id='249a5528ab93418c894f2332c4b9d5cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:28:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b56507-47b2-471e-a0f8-c1d4aa97da4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:28:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b56507-47b2-471e-a0f8-c1d4aa97da4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:28:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae7a0e93-b276-4fb6-834e-ca317d313f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:28:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae7a0e93-b276-4fb6-834e-ca317d313f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1624ce24-8eb3-4a61-8aa5-b82d7eade20b', 'volume_name': 'volume-1624ce24-8eb3-4a61-8aa5-b82d7eade20b', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:28:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f79ffd-faea-45ec-bdac-fd220b757490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:28:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f79ffd-faea-45ec-bdac-fd220b757490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:28:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0505f30-5708-45c3-a634-a84c5026e5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:28:37 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] Volume 1624ce24-8eb3-4a61-8aa5-b82d7eade20b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1624ce24-8eb3-4a61-8aa5-b82d7eade20b', 'volume_size': 1} Jun 04 06:28:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:28:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:28:37 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1667336429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1624ce24-8eb3-4a61-8aa5-b82d7eade20b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789559eba9ce40bea747778105f8afdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:28:38Z,use_quota=True,user_id='249a5528ab93418c894f2332c4b9d5cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:28:37 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] Creating volume 1624ce24-8eb3-4a61-8aa5-b82d7eade20b {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:28:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:28:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:28:37 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:28:37 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:28:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:28:37 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:28:37 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:28:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1624ce24-8eb3-4a61-8aa5-b82d7eade20b 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:28:37 devstack sudo[90829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1624ce24-8eb3-4a61-8aa5-b82d7eade20b 1073741824 Jun 04 06:28:37 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:28:38 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root Jun 04 06:28:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1624ce24-8eb3-4a61-8aa5-b82d7eade20b 1073741824" returned: 0 in 1.084s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:28:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1624ce24-8eb3-4a61-8aa5-b82d7eade20b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:28:39 devstack sudo[90836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1624ce24-8eb3-4a61-8aa5-b82d7eade20b Jun 04 06:28:39 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:28:39 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root Jun 04 06:28:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1624ce24-8eb3-4a61-8aa5-b82d7eade20b" returned: 0 in 0.863s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:28:39 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] <== create_volume: return (2019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:28:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.029s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:28:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0505f30-5708-45c3-a634-a84c5026e5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1624ce24-8eb3-4a61-8aa5-b82d7eade20b', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:28:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (432cd350-86a1-47d9-99d5-4aa61ea3b5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:28:40 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] Volume volume-1624ce24-8eb3-4a61-8aa5-b82d7eade20b (1624ce24-8eb3-4a61-8aa5-b82d7eade20b): created successfully Jun 04 06:28:40 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (432cd350-86a1-47d9-99d5-4aa61ea3b5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:28:40 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] Flow 'volume_create_manager' (0a9f516a-5139-4612-96d8-102faca0a880) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:28:40 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-8e7d3b21-b35b-4a8c-b5d8-9c12de555139 tempest-VolumesTransfersV355Test-1896029493 None] Created volume successfully. Jun 04 06:28:41 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-860af649-d901-4d86-9661-e5d552c565b5 tempest-VolumesTransfersV355Test-15167063 None] Transfer volume completed successfully. Jun 04 06:28:42 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-652a8386-fa4e-4699-a0ff-19345e793526 tempest-VolumesTransfersV355Test-902762251 None] Acquiring lock "cinder-1624ce24-8eb3-4a61-8aa5-b82d7eade20b-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:28:43 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-652a8386-fa4e-4699-a0ff-19345e793526 tempest-VolumesTransfersV355Test-902762251 None] Lock "cinder-1624ce24-8eb3-4a61-8aa5-b82d7eade20b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:28:43 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-652a8386-fa4e-4699-a0ff-19345e793526 tempest-VolumesTransfersV355Test-902762251 None] Acquiring lock "cinder-quobyte-1624ce24-8eb3-4a61-8aa5-b82d7eade20b" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:28:43 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-652a8386-fa4e-4699-a0ff-19345e793526 tempest-VolumesTransfersV355Test-902762251 None] Lock "cinder-quobyte-1624ce24-8eb3-4a61-8aa5-b82d7eade20b" acquired by "delete_volume" :: waited 0.019s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:28:43 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f358a3-cab5-4444-9281-6ed44d21a95b]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:28:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-652a8386-fa4e-4699-a0ff-19345e793526 tempest-VolumesTransfersV355Test-902762251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1624ce24-8eb3-4a61-8aa5-b82d7eade20b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:28:43 devstack sudo[90847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1624ce24-8eb3-4a61-8aa5-b82d7eade20b Jun 04 06:28:43 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:28:44 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root Jun 04 06:28:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-652a8386-fa4e-4699-a0ff-19345e793526 tempest-VolumesTransfersV355Test-902762251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1624ce24-8eb3-4a61-8aa5-b82d7eade20b" returned: 0 in 0.998s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:28:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-652a8386-fa4e-4699-a0ff-19345e793526 tempest-VolumesTransfersV355Test-902762251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1624ce24-8eb3-4a61-8aa5-b82d7eade20b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:28:44 devstack sudo[90853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1624ce24-8eb3-4a61-8aa5-b82d7eade20b Jun 04 06:28:44 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:28:45 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root Jun 04 06:28:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-652a8386-fa4e-4699-a0ff-19345e793526 tempest-VolumesTransfersV355Test-902762251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-1624ce24-8eb3-4a61-8aa5-b82d7eade20b" returned: 0 in 0.924s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:28:45 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-652a8386-fa4e-4699-a0ff-19345e793526 tempest-VolumesTransfersV355Test-902762251 None] Lock "cinder-quobyte-1624ce24-8eb3-4a61-8aa5-b82d7eade20b" released by "delete_volume" :: held 1.974s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:28:45 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-652a8386-fa4e-4699-a0ff-19345e793526 tempest-VolumesTransfersV355Test-902762251 None] Created reservations ['ed2769de-8d67-4953-9de5-7f475687eea8', '0d823659-b78c-41f2-a665-0f1b2887864a', '04b17050-22e0-443f-ad2a-76a562ee6510', 'ded04840-588d-4622-8431-7e7b7de9c707'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:28:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-652a8386-fa4e-4699-a0ff-19345e793526 tempest-VolumesTransfersV355Test-902762251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:28:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-652a8386-fa4e-4699-a0ff-19345e793526 tempest-VolumesTransfersV355Test-902762251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:28:45 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-652a8386-fa4e-4699-a0ff-19345e793526 tempest-VolumesTransfersV355Test-902762251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:28:45 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-652a8386-fa4e-4699-a0ff-19345e793526 tempest-VolumesTransfersV355Test-902762251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:28:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-652a8386-fa4e-4699-a0ff-19345e793526 tempest-VolumesTransfersV355Test-902762251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:28:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-652a8386-fa4e-4699-a0ff-19345e793526 tempest-VolumesTransfersV355Test-902762251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:28:45 devstack sudo[90856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:28:45 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:28:46 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:28:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] Flow 'volume_create_manager' (765d8855-d074-4a1f-ad7e-77b66a0d2ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:28:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2b2f136-b675-4629-947c-fc200bac9981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:28:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2b2f136-b675-4629-947c-fc200bac9981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-168293685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=399de720-6cfd-4354-aa84-060282c3e353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789559eba9ce40bea747778105f8afdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:28:46Z,use_quota=True,user_id='249a5528ab93418c894f2332c4b9d5cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:28:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (138c6d0f-99b3-4e45-bf24-9a9fd72783ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:28:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (138c6d0f-99b3-4e45-bf24-9a9fd72783ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:28:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe2f839-bb80-4b74-8301-b4c5ea8223ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:28:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe2f839-bb80-4b74-8301-b4c5ea8223ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '399de720-6cfd-4354-aa84-060282c3e353', 'volume_name': 'volume-399de720-6cfd-4354-aa84-060282c3e353', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:28:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (280fc6e0-21a6-4217-a123-eb8f042b52da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:28:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (280fc6e0-21a6-4217-a123-eb8f042b52da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:28:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00274f98-f84c-41e1-a7fa-c3fa663aa6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:28:46 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] Volume 399de720-6cfd-4354-aa84-060282c3e353: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-399de720-6cfd-4354-aa84-060282c3e353', 'volume_size': 1} Jun 04 06:28:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:28:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:28:46 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-168293685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=399de720-6cfd-4354-aa84-060282c3e353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789559eba9ce40bea747778105f8afdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:28:46Z,use_quota=True,user_id='249a5528ab93418c894f2332c4b9d5cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:28:46 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] Creating volume 399de720-6cfd-4354-aa84-060282c3e353 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:28:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:28:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:28:46 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:28:46 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:28:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:28:46 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:28:46 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:28:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-399de720-6cfd-4354-aa84-060282c3e353 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:28:46 devstack sudo[90860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-399de720-6cfd-4354-aa84-060282c3e353 1073741824 Jun 04 06:28:46 devstack sudo[90860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:28:46 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root Jun 04 06:28:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-652a8386-fa4e-4699-a0ff-19345e793526 tempest-VolumesTransfersV355Test-902762251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.211s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:28:46 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-652a8386-fa4e-4699-a0ff-19345e793526 tempest-VolumesTransfersV355Test-902762251 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:28:46 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-652a8386-fa4e-4699-a0ff-19345e793526 tempest-VolumesTransfersV355Test-902762251 None] Deleted volume successfully. Jun 04 06:28:46 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-652a8386-fa4e-4699-a0ff-19345e793526 tempest-VolumesTransfersV355Test-902762251 None] Lock "cinder-1624ce24-8eb3-4a61-8aa5-b82d7eade20b-delete_volume" released by "delete_volume" :: held 3.491s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:28:47 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-f8672326-6d65-4514-942d-09cb5fae9332 req-542b23db-f007-4398-8ff2-6fd7be7f3161 tempest-AttachVolumeNegativeTest-499422654 None] Terminate volume connection completed successfully. Jun 04 06:28:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-f8672326-6d65-4514-942d-09cb5fae9332 req-542b23db-f007-4398-8ff2-6fd7be7f3161 tempest-AttachVolumeNegativeTest-499422654 None] Deleting attachment b1bebf63-045f-4ba9-a02b-c9bfc6b94186. {{(pid=86069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 06:28:47 devstack sudo[90860]: pam_unix(sudo:session): session closed for user root Jun 04 06:28:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-399de720-6cfd-4354-aa84-060282c3e353 1073741824" returned: 0 in 1.113s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:28:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-399de720-6cfd-4354-aa84-060282c3e353 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:28:47 devstack sudo[90871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-399de720-6cfd-4354-aa84-060282c3e353 Jun 04 06:28:47 devstack sudo[90871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:28:48 devstack sudo[90871]: pam_unix(sudo:session): session closed for user root Jun 04 06:28:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-399de720-6cfd-4354-aa84-060282c3e353" returned: 0 in 0.651s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:28:48 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] <== create_volume: return (1819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:28:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.823s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:28:48 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00274f98-f84c-41e1-a7fa-c3fa663aa6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-399de720-6cfd-4354-aa84-060282c3e353', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:28:48 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7979722f-82e1-45ea-b697-9ab510bcbc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:28:48 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] Volume volume-399de720-6cfd-4354-aa84-060282c3e353 (399de720-6cfd-4354-aa84-060282c3e353): created successfully Jun 04 06:28:48 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7979722f-82e1-45ea-b697-9ab510bcbc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:28:48 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] Flow 'volume_create_manager' (765d8855-d074-4a1f-ad7e-77b66a0d2ac2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:28:48 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-c2119acb-a96e-4acd-bb53-03d2e5615caa tempest-VolumesTransfersV355Test-1896029493 None] Created volume successfully. Jun 04 06:28:49 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-915eefa0-37d0-46a7-bba9-76663b09bd6b tempest-VolumesTransfersV355Test-902762251 None] Acquiring lock "cinder-399de720-6cfd-4354-aa84-060282c3e353-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:28:49 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-915eefa0-37d0-46a7-bba9-76663b09bd6b tempest-VolumesTransfersV355Test-902762251 None] Lock "cinder-399de720-6cfd-4354-aa84-060282c3e353-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:28:49 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-915eefa0-37d0-46a7-bba9-76663b09bd6b tempest-VolumesTransfersV355Test-902762251 None] Acquiring lock "cinder-quobyte-399de720-6cfd-4354-aa84-060282c3e353" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:28:49 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-915eefa0-37d0-46a7-bba9-76663b09bd6b tempest-VolumesTransfersV355Test-902762251 None] Lock "cinder-quobyte-399de720-6cfd-4354-aa84-060282c3e353" acquired by "delete_volume" :: waited 0.018s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:28:49 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[4effac0d-76ba-411c-81ff-ad6c102b0a77]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:28:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-915eefa0-37d0-46a7-bba9-76663b09bd6b tempest-VolumesTransfersV355Test-902762251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-399de720-6cfd-4354-aa84-060282c3e353 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:28:49 devstack sudo[90894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-399de720-6cfd-4354-aa84-060282c3e353 Jun 04 06:28:49 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:28:50 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root Jun 04 06:28:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-915eefa0-37d0-46a7-bba9-76663b09bd6b tempest-VolumesTransfersV355Test-902762251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-399de720-6cfd-4354-aa84-060282c3e353" returned: 0 in 1.090s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:28:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-915eefa0-37d0-46a7-bba9-76663b09bd6b tempest-VolumesTransfersV355Test-902762251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-399de720-6cfd-4354-aa84-060282c3e353 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:28:50 devstack sudo[90951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-399de720-6cfd-4354-aa84-060282c3e353 Jun 04 06:28:50 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:28:51 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root Jun 04 06:28:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-915eefa0-37d0-46a7-bba9-76663b09bd6b tempest-VolumesTransfersV355Test-902762251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-399de720-6cfd-4354-aa84-060282c3e353" returned: 0 in 0.658s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:28:51 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-915eefa0-37d0-46a7-bba9-76663b09bd6b tempest-VolumesTransfersV355Test-902762251 None] Lock "cinder-quobyte-399de720-6cfd-4354-aa84-060282c3e353" released by "delete_volume" :: held 1.799s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:28:51 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-915eefa0-37d0-46a7-bba9-76663b09bd6b tempest-VolumesTransfersV355Test-902762251 None] Created reservations ['67755457-82d2-46a8-92bb-f4dd3732f149', '36ae443e-55d9-4310-8b68-7d53b9263f25', '08deb0ed-82e1-4e9d-9842-daa6aedc6577', 'c75da696-720d-404e-8cb6-d24bac92fd25'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:28:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-915eefa0-37d0-46a7-bba9-76663b09bd6b tempest-VolumesTransfersV355Test-902762251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:28:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-915eefa0-37d0-46a7-bba9-76663b09bd6b tempest-VolumesTransfersV355Test-902762251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:28:51 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-915eefa0-37d0-46a7-bba9-76663b09bd6b tempest-VolumesTransfersV355Test-902762251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:28:51 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-915eefa0-37d0-46a7-bba9-76663b09bd6b tempest-VolumesTransfersV355Test-902762251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:28:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-915eefa0-37d0-46a7-bba9-76663b09bd6b tempest-VolumesTransfersV355Test-902762251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:28:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-915eefa0-37d0-46a7-bba9-76663b09bd6b tempest-VolumesTransfersV355Test-902762251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:28:51 devstack sudo[90985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:28:51 devstack sudo[90985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:28:52 devstack sudo[90985]: pam_unix(sudo:session): session closed for user root Jun 04 06:28:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-915eefa0-37d0-46a7-bba9-76663b09bd6b tempest-VolumesTransfersV355Test-902762251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.670s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:28:52 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-915eefa0-37d0-46a7-bba9-76663b09bd6b tempest-VolumesTransfersV355Test-902762251 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:28:52 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-915eefa0-37d0-46a7-bba9-76663b09bd6b tempest-VolumesTransfersV355Test-902762251 None] Deleted volume successfully. Jun 04 06:28:52 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-915eefa0-37d0-46a7-bba9-76663b09bd6b tempest-VolumesTransfersV355Test-902762251 None] Lock "cinder-399de720-6cfd-4354-aa84-060282c3e353-delete_volume" released by "delete_volume" :: held 2.717s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:28:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-cc53b76f-e227-4f0a-b798-55b2eb9a05f0 req-0d647c99-4d0e-4f04-811d-38073cf5a8bd tempest-TaggedAttachmentsTest-1196106279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:28:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-cc53b76f-e227-4f0a-b798-55b2eb9a05f0 req-0d647c99-4d0e-4f04-811d-38073cf5a8bd tempest-TaggedAttachmentsTest-1196106279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:28:56 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a987304-79dd-4996-8c36-5e5e025898ba]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:28:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-cc53b76f-e227-4f0a-b798-55b2eb9a05f0 req-0d647c99-4d0e-4f04-811d-38073cf5a8bd tempest-TaggedAttachmentsTest-1196106279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9fcc457b-2c91-4254-85e2-d36be222bd20 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:28:57 devstack sudo[91002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9fcc457b-2c91-4254-85e2-d36be222bd20 Jun 04 06:28:57 devstack sudo[91002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:28:57 devstack sudo[91002]: pam_unix(sudo:session): session closed for user root Jun 04 06:28:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-cc53b76f-e227-4f0a-b798-55b2eb9a05f0 req-0d647c99-4d0e-4f04-811d-38073cf5a8bd tempest-TaggedAttachmentsTest-1196106279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9fcc457b-2c91-4254-85e2-d36be222bd20" returned: 0 in 0.907s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:28:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-cc53b76f-e227-4f0a-b798-55b2eb9a05f0 req-0d647c99-4d0e-4f04-811d-38073cf5a8bd tempest-TaggedAttachmentsTest-1196106279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.935s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:28:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-cc53b76f-e227-4f0a-b798-55b2eb9a05f0 req-0d647c99-4d0e-4f04-811d-38073cf5a8bd tempest-TaggedAttachmentsTest-1196106279 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574', 'name': 'volume-9fcc457b-2c91-4254-85e2-d36be222bd20', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f45c8da5-66c1-412f-beb2-8d4b5eb7e337', 'enforce_multipath': True} {{(pid=86069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 06:28:57 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-cc53b76f-e227-4f0a-b798-55b2eb9a05f0 req-0d647c99-4d0e-4f04-811d-38073cf5a8bd tempest-TaggedAttachmentsTest-1196106279 None] attachment_update completed successfully. Jun 04 06:29:00 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:29:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] Flow 'volume_create_manager' (3f22887e-d85f-4a28-bc27-adcc7a091dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:29:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f760e380-827d-44f0-bd9a-8d05a25a49ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:29:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f760e380-827d-44f0-bd9a-8d05a25a49ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2107213837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4ca9d9e-4d56-44e2-bec6-3003345cad1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='702ff75150a14e39bd77dce218efc46f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:29:00Z,use_quota=True,user_id='769c0737491d45ef864091ea76cfa4a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:29:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02e7700f-efbb-4b83-b97b-4d0185648138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:29:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02e7700f-efbb-4b83-b97b-4d0185648138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:29:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb28ec5-8a29-4e3e-bf7f-c0babcebacd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:29:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb28ec5-8a29-4e3e-bf7f-c0babcebacd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4ca9d9e-4d56-44e2-bec6-3003345cad1c', 'volume_name': 'volume-d4ca9d9e-4d56-44e2-bec6-3003345cad1c', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:29:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c4629bb-5729-4465-8d84-80a4b58396b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:29:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c4629bb-5729-4465-8d84-80a4b58396b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:29:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f23075-bdeb-4173-a8fd-981b96a8aa16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:29:00 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] Volume d4ca9d9e-4d56-44e2-bec6-3003345cad1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4ca9d9e-4d56-44e2-bec6-3003345cad1c', 'volume_size': 1} Jun 04 06:29:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:29:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:29:00 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2107213837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4ca9d9e-4d56-44e2-bec6-3003345cad1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='702ff75150a14e39bd77dce218efc46f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:29:00Z,use_quota=True,user_id='769c0737491d45ef864091ea76cfa4a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:29:00 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] Creating volume d4ca9d9e-4d56-44e2-bec6-3003345cad1c {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:29:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:29:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:29:00 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:29:00 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:29:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:29:00 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:29:00 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:29:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4ca9d9e-4d56-44e2-bec6-3003345cad1c 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:29:00 devstack sudo[91391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4ca9d9e-4d56-44e2-bec6-3003345cad1c 1073741824 Jun 04 06:29:00 devstack sudo[91391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:29:01 devstack sudo[91391]: pam_unix(sudo:session): session closed for user root Jun 04 06:29:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4ca9d9e-4d56-44e2-bec6-3003345cad1c 1073741824" returned: 0 in 1.003s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:29:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4ca9d9e-4d56-44e2-bec6-3003345cad1c {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:29:01 devstack sudo[91400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4ca9d9e-4d56-44e2-bec6-3003345cad1c Jun 04 06:29:01 devstack sudo[91400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:29:02 devstack sudo[91400]: pam_unix(sudo:session): session closed for user root Jun 04 06:29:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4ca9d9e-4d56-44e2-bec6-3003345cad1c" returned: 0 in 0.690s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:29:02 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:29:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:29:02 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f23075-bdeb-4173-a8fd-981b96a8aa16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4ca9d9e-4d56-44e2-bec6-3003345cad1c', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:29:02 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98940d52-8242-4188-9756-0f40983e8ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:29:02 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] Volume volume-d4ca9d9e-4d56-44e2-bec6-3003345cad1c (d4ca9d9e-4d56-44e2-bec6-3003345cad1c): created successfully Jun 04 06:29:02 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98940d52-8242-4188-9756-0f40983e8ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:29:02 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] Flow 'volume_create_manager' (3f22887e-d85f-4a28-bc27-adcc7a091dd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:29:02 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-7d54007a-1a67-4590-8708-87c0cf0d59d8 tempest-AttachVolumeTestJSON-1138902684 None] Created volume successfully. Jun 04 06:29:05 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-22999de8-3744-4560-b226-e444eb8d046b req-334709b0-f7e8-483c-bd87-419b46a349cb tempest-TaggedAttachmentsTest-1196106279 None] Terminate volume connection completed successfully. Jun 04 06:29:05 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-22999de8-3744-4560-b226-e444eb8d046b req-334709b0-f7e8-483c-bd87-419b46a349cb tempest-TaggedAttachmentsTest-1196106279 None] Deleting attachment f45c8da5-66c1-412f-beb2-8d4b5eb7e337. {{(pid=86069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 06:29:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-fb5c39ff-677a-4433-aa35-604174c9adf5 req-802701c7-aa0f-463b-aa8a-107f58f22592 tempest-AttachVolumeTestJSON-1138902684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:29:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-fb5c39ff-677a-4433-aa35-604174c9adf5 req-802701c7-aa0f-463b-aa8a-107f58f22592 tempest-AttachVolumeTestJSON-1138902684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:29:05 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4e889e-64ea-4412-9f9c-94b40c1d1881]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:29:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-fb5c39ff-677a-4433-aa35-604174c9adf5 req-802701c7-aa0f-463b-aa8a-107f58f22592 tempest-AttachVolumeTestJSON-1138902684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4ca9d9e-4d56-44e2-bec6-3003345cad1c {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:29:05 devstack sudo[91458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4ca9d9e-4d56-44e2-bec6-3003345cad1c Jun 04 06:29:05 devstack sudo[91458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:29:06 devstack sudo[91458]: pam_unix(sudo:session): session closed for user root Jun 04 06:29:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-fb5c39ff-677a-4433-aa35-604174c9adf5 req-802701c7-aa0f-463b-aa8a-107f58f22592 tempest-AttachVolumeTestJSON-1138902684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4ca9d9e-4d56-44e2-bec6-3003345cad1c" returned: 0 in 0.885s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:29:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-fb5c39ff-677a-4433-aa35-604174c9adf5 req-802701c7-aa0f-463b-aa8a-107f58f22592 tempest-AttachVolumeTestJSON-1138902684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.909s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:29:06 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-fb5c39ff-677a-4433-aa35-604174c9adf5 req-802701c7-aa0f-463b-aa8a-107f58f22592 tempest-AttachVolumeTestJSON-1138902684 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574', 'name': 'volume-d4ca9d9e-4d56-44e2-bec6-3003345cad1c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3af99633-3914-4fe1-9129-dcb7467b0fed', 'enforce_multipath': True} {{(pid=86069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 06:29:06 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-fb5c39ff-677a-4433-aa35-604174c9adf5 req-802701c7-aa0f-463b-aa8a-107f58f22592 tempest-AttachVolumeTestJSON-1138902684 None] attachment_update completed successfully. Jun 04 06:29:09 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:29:09 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] Flow 'volume_create_manager' (7dc9f791-19ee-4133-9c19-ce22223e2f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:29:09 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3babd3d-b362-47d4-abd1-a9b671c061cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:29:09 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3babd3d-b362-47d4-abd1-a9b671c061cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-191687927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9392238c-6c87-483e-9078-1ac623357ce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2165f134f0af46098e73812006bf4ba8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:29:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:29:09Z,use_quota=True,user_id='62f4b1ccff1a40ca9093fbbcd469a5de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:29:09 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ef063a-dcf4-4f3f-9f03-72729fc7e573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:29:09 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ef063a-dcf4-4f3f-9f03-72729fc7e573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:29:09 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0bd0e23-f33d-447f-9113-0fc0c4938187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:29:09 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0bd0e23-f33d-447f-9113-0fc0c4938187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9392238c-6c87-483e-9078-1ac623357ce0', 'volume_name': 'volume-9392238c-6c87-483e-9078-1ac623357ce0', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:29:09 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e72dab73-2b7a-41d8-8ddb-a910de814197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:29:09 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e72dab73-2b7a-41d8-8ddb-a910de814197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:29:09 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee8a5fb9-7298-4b9e-8145-7b3c29433790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:29:09 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] Volume 9392238c-6c87-483e-9078-1ac623357ce0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9392238c-6c87-483e-9078-1ac623357ce0', 'volume_size': 1} Jun 04 06:29:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:29:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:29:09 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-191687927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9392238c-6c87-483e-9078-1ac623357ce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2165f134f0af46098e73812006bf4ba8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:29:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:29:09Z,use_quota=True,user_id='62f4b1ccff1a40ca9093fbbcd469a5de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:29:09 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] Creating volume 9392238c-6c87-483e-9078-1ac623357ce0 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:29:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:29:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:29:09 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:29:09 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:29:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:29:09 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:29:09 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:29:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:29:09 devstack sudo[91875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0 1073741824 Jun 04 06:29:09 devstack sudo[91875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:29:10 devstack sudo[91875]: pam_unix(sudo:session): session closed for user root Jun 04 06:29:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0 1073741824" returned: 0 in 0.866s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:29:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:29:10 devstack sudo[91886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0 Jun 04 06:29:10 devstack sudo[91886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:29:10 devstack sudo[91886]: pam_unix(sudo:session): session closed for user root Jun 04 06:29:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0" returned: 0 in 0.646s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:29:10 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:29:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:29:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee8a5fb9-7298-4b9e-8145-7b3c29433790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9392238c-6c87-483e-9078-1ac623357ce0', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:29:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3728080-61e8-4210-8d5b-19cdc3853925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:29:10 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] Volume volume-9392238c-6c87-483e-9078-1ac623357ce0 (9392238c-6c87-483e-9078-1ac623357ce0): created successfully Jun 04 06:29:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3728080-61e8-4210-8d5b-19cdc3853925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:29:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] Flow 'volume_create_manager' (7dc9f791-19ee-4133-9c19-ce22223e2f4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:29:10 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-46ef5bad-01aa-4d16-a9b0-98cf1cbad2f4 tempest-VolumesActionsTest-295207613 None] Created volume successfully. Jun 04 06:29:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:29:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:29:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:29:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:29:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:29:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:29:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:29:11 devstack sudo[91889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:29:11 devstack sudo[91889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:29:11 devstack sudo[91889]: pam_unix(sudo:session): session closed for user root Jun 04 06:29:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.683s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:29:11 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:29:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager._thread_info {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:29:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread count: 8 {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 06:29:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread info: [<_MainThread(MainThread, started 131797370544256)>, , , , , , , ] {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 06:29:12 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:29:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] Flow 'volume_create_manager' (b2121136-225a-4932-9d51-67622b8b3c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:29:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a17a94-3c0f-4f68-b9d9-5452e2bb0dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:29:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a17a94-3c0f-4f68-b9d9-5452e2bb0dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1558582161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b08b10-5d41-44e7-9bc3-18ba0494faeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='702ff75150a14e39bd77dce218efc46f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:29:13Z,use_quota=True,user_id='769c0737491d45ef864091ea76cfa4a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:29:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e45ce233-66e1-4350-bd7a-dd89de59ba26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:29:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e45ce233-66e1-4350-bd7a-dd89de59ba26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:29:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c52867-c160-4939-99c9-8c20c9bb5505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:29:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c52867-c160-4939-99c9-8c20c9bb5505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15b08b10-5d41-44e7-9bc3-18ba0494faeb', 'volume_name': 'volume-15b08b10-5d41-44e7-9bc3-18ba0494faeb', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:29:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8a88c50-4e40-41c7-822a-a7a4925137e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:29:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8a88c50-4e40-41c7-822a-a7a4925137e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:29:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e10a20f-aa92-49d1-8197-a0341287ad3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:29:12 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] Volume 15b08b10-5d41-44e7-9bc3-18ba0494faeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15b08b10-5d41-44e7-9bc3-18ba0494faeb', 'volume_size': 1} Jun 04 06:29:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:29:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:29:12 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1558582161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b08b10-5d41-44e7-9bc3-18ba0494faeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='702ff75150a14e39bd77dce218efc46f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:29:13Z,use_quota=True,user_id='769c0737491d45ef864091ea76cfa4a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:29:12 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] Creating volume 15b08b10-5d41-44e7-9bc3-18ba0494faeb {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:29:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:29:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:29:12 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:29:12 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:29:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:29:12 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:29:12 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:29:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-15b08b10-5d41-44e7-9bc3-18ba0494faeb 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:29:12 devstack sudo[91897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-15b08b10-5d41-44e7-9bc3-18ba0494faeb 1073741824 Jun 04 06:29:12 devstack sudo[91897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:29:13 devstack sudo[91897]: pam_unix(sudo:session): session closed for user root Jun 04 06:29:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-15b08b10-5d41-44e7-9bc3-18ba0494faeb 1073741824" returned: 0 in 0.938s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:29:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-15b08b10-5d41-44e7-9bc3-18ba0494faeb {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:29:13 devstack sudo[91903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-15b08b10-5d41-44e7-9bc3-18ba0494faeb Jun 04 06:29:13 devstack sudo[91903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:29:14 devstack sudo[91903]: pam_unix(sudo:session): session closed for user root Jun 04 06:29:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-15b08b10-5d41-44e7-9bc3-18ba0494faeb" returned: 0 in 0.720s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:29:14 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:29:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:29:14 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e10a20f-aa92-49d1-8197-a0341287ad3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15b08b10-5d41-44e7-9bc3-18ba0494faeb', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:29:14 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0016edec-529d-4fa6-aaf1-5707d6304af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:29:14 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] Volume volume-15b08b10-5d41-44e7-9bc3-18ba0494faeb (15b08b10-5d41-44e7-9bc3-18ba0494faeb): created successfully Jun 04 06:29:14 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0016edec-529d-4fa6-aaf1-5707d6304af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:29:14 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] Flow 'volume_create_manager' (b2121136-225a-4932-9d51-67622b8b3c40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:29:14 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-c0337dd5-3d12-4f5c-a838-0028c6b9b7cd tempest-AttachVolumeTestJSON-1138902684 None] Created volume successfully. Jun 04 06:29:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-b3dce956-7756-4a76-a049-144984c32a20 req-8d0c7bf1-f725-4ebd-b48e-daddad5d30ee tempest-AttachVolumeTestJSON-1138902684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:29:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-b3dce956-7756-4a76-a049-144984c32a20 req-8d0c7bf1-f725-4ebd-b48e-daddad5d30ee tempest-AttachVolumeTestJSON-1138902684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:29:18 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[048b4428-3f87-4475-a78f-c710d34023d3]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:29:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-b3dce956-7756-4a76-a049-144984c32a20 req-8d0c7bf1-f725-4ebd-b48e-daddad5d30ee tempest-AttachVolumeTestJSON-1138902684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-15b08b10-5d41-44e7-9bc3-18ba0494faeb {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:29:18 devstack sudo[92023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-15b08b10-5d41-44e7-9bc3-18ba0494faeb Jun 04 06:29:18 devstack sudo[92023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:29:19 devstack sudo[92023]: pam_unix(sudo:session): session closed for user root Jun 04 06:29:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-b3dce956-7756-4a76-a049-144984c32a20 req-8d0c7bf1-f725-4ebd-b48e-daddad5d30ee tempest-AttachVolumeTestJSON-1138902684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-15b08b10-5d41-44e7-9bc3-18ba0494faeb" returned: 0 in 1.178s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:29:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-b3dce956-7756-4a76-a049-144984c32a20 req-8d0c7bf1-f725-4ebd-b48e-daddad5d30ee tempest-AttachVolumeTestJSON-1138902684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.218s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:29:19 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-b3dce956-7756-4a76-a049-144984c32a20 req-8d0c7bf1-f725-4ebd-b48e-daddad5d30ee tempest-AttachVolumeTestJSON-1138902684 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574', 'name': 'volume-15b08b10-5d41-44e7-9bc3-18ba0494faeb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ccbaa139-1520-464a-9339-10d8d54061c1', 'enforce_multipath': True} {{(pid=86069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 06:29:19 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-b3dce956-7756-4a76-a049-144984c32a20 req-8d0c7bf1-f725-4ebd-b48e-daddad5d30ee tempest-AttachVolumeTestJSON-1138902684 None] attachment_update completed successfully. Jun 04 06:29:25 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4b55c700-7abb-413b-9247-cf07b855ccd3 tempest-TaggedAttachmentsTest-1196106279 None] Acquiring lock "cinder-9fcc457b-2c91-4254-85e2-d36be222bd20-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:29:25 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4b55c700-7abb-413b-9247-cf07b855ccd3 tempest-TaggedAttachmentsTest-1196106279 None] Lock "cinder-9fcc457b-2c91-4254-85e2-d36be222bd20-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:29:25 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=40,cinder:UPDATE=51,cinder:INSERT=9,cinder:DELETE=3 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:29:25 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=53,cinder:UPDATE=43,cinder:INSERT=9,cinder:DELETE=6 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:29:25 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4b55c700-7abb-413b-9247-cf07b855ccd3 tempest-TaggedAttachmentsTest-1196106279 None] Acquiring lock "cinder-quobyte-9fcc457b-2c91-4254-85e2-d36be222bd20" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:29:25 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4b55c700-7abb-413b-9247-cf07b855ccd3 tempest-TaggedAttachmentsTest-1196106279 None] Lock "cinder-quobyte-9fcc457b-2c91-4254-85e2-d36be222bd20" acquired by "delete_volume" :: waited 0.046s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:29:25 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff85d62-b9b9-460d-9c49-29b7e6ecdda1]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:29:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4b55c700-7abb-413b-9247-cf07b855ccd3 tempest-TaggedAttachmentsTest-1196106279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9fcc457b-2c91-4254-85e2-d36be222bd20 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:29:25 devstack sudo[92151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9fcc457b-2c91-4254-85e2-d36be222bd20 Jun 04 06:29:25 devstack sudo[92151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:29:26 devstack sudo[92151]: pam_unix(sudo:session): session closed for user root Jun 04 06:29:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4b55c700-7abb-413b-9247-cf07b855ccd3 tempest-TaggedAttachmentsTest-1196106279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9fcc457b-2c91-4254-85e2-d36be222bd20" returned: 0 in 0.939s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:29:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4b55c700-7abb-413b-9247-cf07b855ccd3 tempest-TaggedAttachmentsTest-1196106279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9fcc457b-2c91-4254-85e2-d36be222bd20 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:29:26 devstack sudo[92163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9fcc457b-2c91-4254-85e2-d36be222bd20 Jun 04 06:29:26 devstack sudo[92163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:29:27 devstack sudo[92163]: pam_unix(sudo:session): session closed for user root Jun 04 06:29:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4b55c700-7abb-413b-9247-cf07b855ccd3 tempest-TaggedAttachmentsTest-1196106279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9fcc457b-2c91-4254-85e2-d36be222bd20" returned: 0 in 0.632s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:29:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4b55c700-7abb-413b-9247-cf07b855ccd3 tempest-TaggedAttachmentsTest-1196106279 None] Lock "cinder-quobyte-9fcc457b-2c91-4254-85e2-d36be222bd20" released by "delete_volume" :: held 1.660s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:29:27 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-4b55c700-7abb-413b-9247-cf07b855ccd3 tempest-TaggedAttachmentsTest-1196106279 None] Created reservations ['3cc0988e-647d-4b0c-9707-d6cf8f11d886', '49865553-00fb-4abe-9fb7-45b752e1865a', '38388544-73c9-49b5-aa76-f5dbf1de9240', '83063e5a-fc5c-40de-a806-25aeb45dd393'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:29:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-4b55c700-7abb-413b-9247-cf07b855ccd3 tempest-TaggedAttachmentsTest-1196106279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:29:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-4b55c700-7abb-413b-9247-cf07b855ccd3 tempest-TaggedAttachmentsTest-1196106279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:29:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-4b55c700-7abb-413b-9247-cf07b855ccd3 tempest-TaggedAttachmentsTest-1196106279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:29:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-4b55c700-7abb-413b-9247-cf07b855ccd3 tempest-TaggedAttachmentsTest-1196106279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:29:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-4b55c700-7abb-413b-9247-cf07b855ccd3 tempest-TaggedAttachmentsTest-1196106279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:29:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4b55c700-7abb-413b-9247-cf07b855ccd3 tempest-TaggedAttachmentsTest-1196106279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:29:27 devstack sudo[92167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:29:27 devstack sudo[92167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:29:28 devstack sudo[92167]: pam_unix(sudo:session): session closed for user root Jun 04 06:29:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4b55c700-7abb-413b-9247-cf07b855ccd3 tempest-TaggedAttachmentsTest-1196106279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.016s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:29:28 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-4b55c700-7abb-413b-9247-cf07b855ccd3 tempest-TaggedAttachmentsTest-1196106279 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:29:28 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-4b55c700-7abb-413b-9247-cf07b855ccd3 tempest-TaggedAttachmentsTest-1196106279 None] Deleted volume successfully. Jun 04 06:29:28 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4b55c700-7abb-413b-9247-cf07b855ccd3 tempest-TaggedAttachmentsTest-1196106279 None] Lock "cinder-9fcc457b-2c91-4254-85e2-d36be222bd20-delete_volume" released by "delete_volume" :: held 3.102s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:29:29 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-b5b9b7e4-66ab-4cda-ba61-48f1c879cdf9 req-7bb052bb-7647-44ff-aff0-8ed53ce97bae tempest-AttachVolumeTestJSON-1138902684 None] Terminate volume connection completed successfully. Jun 04 06:29:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-b5b9b7e4-66ab-4cda-ba61-48f1c879cdf9 req-7bb052bb-7647-44ff-aff0-8ed53ce97bae tempest-AttachVolumeTestJSON-1138902684 None] Deleting attachment 3af99633-3914-4fe1-9129-dcb7467b0fed. {{(pid=86069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 06:29:29 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-170a3658-7443-4f1a-9d7b-fc9dbccb0c43 tempest-VolumesActionsTest-295207613 None] Acquiring lock "cinder-9392238c-6c87-483e-9078-1ac623357ce0" by "attach_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:29:29 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-170a3658-7443-4f1a-9d7b-fc9dbccb0c43 tempest-VolumesActionsTest-295207613 None] Lock "cinder-9392238c-6c87-483e-9078-1ac623357ce0" acquired by "attach_volume" :: waited 0.020s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:29:29 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-170a3658-7443-4f1a-9d7b-fc9dbccb0c43 tempest-VolumesActionsTest-295207613 None] Attaching volume 9392238c-6c87-483e-9078-1ac623357ce0 to instance ae84b4cc-06d2-44a7-a10a-49d3bc84a573 at mountpoint /dev/vdb on host None. Jun 04 06:29:29 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-170a3658-7443-4f1a-9d7b-fc9dbccb0c43 tempest-VolumesActionsTest-295207613 None] Attach volume completed successfully. Jun 04 06:29:29 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-170a3658-7443-4f1a-9d7b-fc9dbccb0c43 tempest-VolumesActionsTest-295207613 None] Lock "cinder-9392238c-6c87-483e-9078-1ac623357ce0" released by "attach_volume" :: held 0.100s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:29:30 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-103df6b2-f5f5-4aa8-a80f-05c4c9ddc0c8 tempest-VolumesActionsTest-295207613 None] Acquiring lock "cinder-9392238c-6c87-483e-9078-1ac623357ce0-detach_volume" by "detach_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:29:30 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-103df6b2-f5f5-4aa8-a80f-05c4c9ddc0c8 tempest-VolumesActionsTest-295207613 None] Lock "cinder-9392238c-6c87-483e-9078-1ac623357ce0-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:29:30 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-103df6b2-f5f5-4aa8-a80f-05c4c9ddc0c8 tempest-VolumesActionsTest-295207613 None] Detaching volume 9392238c-6c87-483e-9078-1ac623357ce0 from instance ae84b4cc-06d2-44a7-a10a-49d3bc84a573. Jun 04 06:29:30 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-103df6b2-f5f5-4aa8-a80f-05c4c9ddc0c8 tempest-VolumesActionsTest-295207613 None] Detach volume completed successfully. Jun 04 06:29:30 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-103df6b2-f5f5-4aa8-a80f-05c4c9ddc0c8 tempest-VolumesActionsTest-295207613 None] Lock "cinder-9392238c-6c87-483e-9078-1ac623357ce0-detach_volume" released by "detach_volume" :: held 0.077s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:29:32 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-25c51b2b-57d3-48f7-903c-462f2bf7d0c2 req-dca84a10-34db-4efc-a85f-6641fefd2d76 tempest-AttachVolumeTestJSON-1138902684 None] Terminate volume connection completed successfully. Jun 04 06:29:32 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-25c51b2b-57d3-48f7-903c-462f2bf7d0c2 req-dca84a10-34db-4efc-a85f-6641fefd2d76 tempest-AttachVolumeTestJSON-1138902684 None] Deleting attachment ccbaa139-1520-464a-9339-10d8d54061c1. {{(pid=86069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 06:29:41 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:29:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] Flow 'volume_create_manager' (09334d46-944e-4bea-bc83-2ff91f57f2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:29:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99042d0f-17f9-4aaa-a798-facc7e9b1ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:29:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99042d0f-17f9-4aaa-a798-facc7e9b1ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1977342280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=493151b7-5ffa-4c77-92a1-7c09178b2036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bdde5be5eff46e9b943f720e48197c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:29:41Z,use_quota=True,user_id='33c0a4d7c711403b820f5d41828a613c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:29:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (522bc7c2-1bd6-4361-83f5-9c58000f0769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:29:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (522bc7c2-1bd6-4361-83f5-9c58000f0769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:29:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (861a5994-cfd7-472e-bba8-d8a5aebce291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:29:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (861a5994-cfd7-472e-bba8-d8a5aebce291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '493151b7-5ffa-4c77-92a1-7c09178b2036', 'volume_name': 'volume-493151b7-5ffa-4c77-92a1-7c09178b2036', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:29:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c6bf8d2-2583-47b4-a51a-07fdc841b1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:29:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c6bf8d2-2583-47b4-a51a-07fdc841b1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:29:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82d1bf26-f00e-4480-ad90-0a08da3c877e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:29:41 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] Volume 493151b7-5ffa-4c77-92a1-7c09178b2036: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-493151b7-5ffa-4c77-92a1-7c09178b2036', 'volume_size': 1} Jun 04 06:29:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:29:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:29:41 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1977342280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=493151b7-5ffa-4c77-92a1-7c09178b2036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bdde5be5eff46e9b943f720e48197c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:29:41Z,use_quota=True,user_id='33c0a4d7c711403b820f5d41828a613c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:29:41 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] Creating volume 493151b7-5ffa-4c77-92a1-7c09178b2036 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:29:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:29:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:29:41 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:29:41 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:29:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:29:41 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:29:41 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:29:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-493151b7-5ffa-4c77-92a1-7c09178b2036 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:29:41 devstack sudo[92332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-493151b7-5ffa-4c77-92a1-7c09178b2036 1073741824 Jun 04 06:29:41 devstack sudo[92332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:29:42 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=14,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:29:42 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ee467e15-3d9a-4a9c-8807-aa41e7ecca28 tempest-AttachVolumeTestJSON-1138902684 None] Acquiring lock "cinder-15b08b10-5d41-44e7-9bc3-18ba0494faeb-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:29:42 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ee467e15-3d9a-4a9c-8807-aa41e7ecca28 tempest-AttachVolumeTestJSON-1138902684 None] Lock "cinder-15b08b10-5d41-44e7-9bc3-18ba0494faeb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:29:42 devstack sudo[92332]: pam_unix(sudo:session): session closed for user root Jun 04 06:29:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-493151b7-5ffa-4c77-92a1-7c09178b2036 1073741824" returned: 0 in 1.030s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:29:42 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ee467e15-3d9a-4a9c-8807-aa41e7ecca28 tempest-AttachVolumeTestJSON-1138902684 None] Acquiring lock "cinder-quobyte-15b08b10-5d41-44e7-9bc3-18ba0494faeb" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:29:42 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ee467e15-3d9a-4a9c-8807-aa41e7ecca28 tempest-AttachVolumeTestJSON-1138902684 None] Lock "cinder-quobyte-15b08b10-5d41-44e7-9bc3-18ba0494faeb" acquired by "delete_volume" :: waited 0.024s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:29:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-493151b7-5ffa-4c77-92a1-7c09178b2036 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:29:42 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[b478ba99-9ef1-4dc0-825f-4d1a4fe94060]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:29:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ee467e15-3d9a-4a9c-8807-aa41e7ecca28 tempest-AttachVolumeTestJSON-1138902684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-15b08b10-5d41-44e7-9bc3-18ba0494faeb {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:29:42 devstack sudo[92338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-493151b7-5ffa-4c77-92a1-7c09178b2036 Jun 04 06:29:42 devstack sudo[92338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:29:42 devstack sudo[92339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-15b08b10-5d41-44e7-9bc3-18ba0494faeb Jun 04 06:29:42 devstack sudo[92339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:29:43 devstack sudo[92338]: pam_unix(sudo:session): session closed for user root Jun 04 06:29:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-493151b7-5ffa-4c77-92a1-7c09178b2036" returned: 0 in 0.691s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:29:43 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:29:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:29:43 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82d1bf26-f00e-4480-ad90-0a08da3c877e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-493151b7-5ffa-4c77-92a1-7c09178b2036', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:29:43 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8e6a15c-9895-4838-b72c-05cd3bf496d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:29:43 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] Volume volume-493151b7-5ffa-4c77-92a1-7c09178b2036 (493151b7-5ffa-4c77-92a1-7c09178b2036): created successfully Jun 04 06:29:43 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8e6a15c-9895-4838-b72c-05cd3bf496d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:29:43 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] Flow 'volume_create_manager' (09334d46-944e-4bea-bc83-2ff91f57f2c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:29:43 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-13b13c48-6c60-4d4f-bad4-6ad7967b6733 tempest-AttachVolumeNegativeTest-499422654 None] Created volume successfully. Jun 04 06:29:43 devstack sudo[92339]: pam_unix(sudo:session): session closed for user root Jun 04 06:29:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ee467e15-3d9a-4a9c-8807-aa41e7ecca28 tempest-AttachVolumeTestJSON-1138902684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-15b08b10-5d41-44e7-9bc3-18ba0494faeb" returned: 0 in 0.800s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:29:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ee467e15-3d9a-4a9c-8807-aa41e7ecca28 tempest-AttachVolumeTestJSON-1138902684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-15b08b10-5d41-44e7-9bc3-18ba0494faeb {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:29:43 devstack sudo[92347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-15b08b10-5d41-44e7-9bc3-18ba0494faeb Jun 04 06:29:43 devstack sudo[92347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:29:44 devstack sudo[92347]: pam_unix(sudo:session): session closed for user root Jun 04 06:29:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ee467e15-3d9a-4a9c-8807-aa41e7ecca28 tempest-AttachVolumeTestJSON-1138902684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-15b08b10-5d41-44e7-9bc3-18ba0494faeb" returned: 0 in 0.664s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:29:44 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ee467e15-3d9a-4a9c-8807-aa41e7ecca28 tempest-AttachVolumeTestJSON-1138902684 None] Lock "cinder-quobyte-15b08b10-5d41-44e7-9bc3-18ba0494faeb" released by "delete_volume" :: held 1.518s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:29:44 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-ee467e15-3d9a-4a9c-8807-aa41e7ecca28 tempest-AttachVolumeTestJSON-1138902684 None] Created reservations ['5ca9b976-cf8e-4c16-b0fa-3ad57b9bac77', '99568ec3-01fc-476b-95cf-1f920f9d6e73', '74f4dcc5-73c7-4db0-8d4e-dfdb912a943e', '6e91576d-c811-49b7-9981-da484240ea96'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:29:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ee467e15-3d9a-4a9c-8807-aa41e7ecca28 tempest-AttachVolumeTestJSON-1138902684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:29:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ee467e15-3d9a-4a9c-8807-aa41e7ecca28 tempest-AttachVolumeTestJSON-1138902684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:29:44 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ee467e15-3d9a-4a9c-8807-aa41e7ecca28 tempest-AttachVolumeTestJSON-1138902684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:29:44 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ee467e15-3d9a-4a9c-8807-aa41e7ecca28 tempest-AttachVolumeTestJSON-1138902684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:29:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ee467e15-3d9a-4a9c-8807-aa41e7ecca28 tempest-AttachVolumeTestJSON-1138902684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:29:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ee467e15-3d9a-4a9c-8807-aa41e7ecca28 tempest-AttachVolumeTestJSON-1138902684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:29:44 devstack sudo[92350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:29:44 devstack sudo[92350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:29:44 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-bc0a097b-0084-480c-93ac-08c6e9caf284 tempest-AttachVolumeTestJSON-1138902684 None] Acquiring lock "cinder-d4ca9d9e-4d56-44e2-bec6-3003345cad1c-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:29:44 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-bc0a097b-0084-480c-93ac-08c6e9caf284 tempest-AttachVolumeTestJSON-1138902684 None] Lock "cinder-d4ca9d9e-4d56-44e2-bec6-3003345cad1c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:29:44 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-bc0a097b-0084-480c-93ac-08c6e9caf284 tempest-AttachVolumeTestJSON-1138902684 None] Acquiring lock "cinder-quobyte-d4ca9d9e-4d56-44e2-bec6-3003345cad1c" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:29:44 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-bc0a097b-0084-480c-93ac-08c6e9caf284 tempest-AttachVolumeTestJSON-1138902684 None] Lock "cinder-quobyte-d4ca9d9e-4d56-44e2-bec6-3003345cad1c" acquired by "delete_volume" :: waited 0.023s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:29:44 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4b4c27-f98e-42d5-b4a5-2a8e7ec59861]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:29:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bc0a097b-0084-480c-93ac-08c6e9caf284 tempest-AttachVolumeTestJSON-1138902684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4ca9d9e-4d56-44e2-bec6-3003345cad1c {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:29:44 devstack sudo[92350]: pam_unix(sudo:session): session closed for user root Jun 04 06:29:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ee467e15-3d9a-4a9c-8807-aa41e7ecca28 tempest-AttachVolumeTestJSON-1138902684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.721s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:29:44 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-ee467e15-3d9a-4a9c-8807-aa41e7ecca28 tempest-AttachVolumeTestJSON-1138902684 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:29:45 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-ee467e15-3d9a-4a9c-8807-aa41e7ecca28 tempest-AttachVolumeTestJSON-1138902684 None] Deleted volume successfully. Jun 04 06:29:45 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ee467e15-3d9a-4a9c-8807-aa41e7ecca28 tempest-AttachVolumeTestJSON-1138902684 None] Lock "cinder-15b08b10-5d41-44e7-9bc3-18ba0494faeb-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:29:45 devstack sudo[92353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4ca9d9e-4d56-44e2-bec6-3003345cad1c Jun 04 06:29:45 devstack sudo[92353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:29:45 devstack sudo[92353]: pam_unix(sudo:session): session closed for user root Jun 04 06:29:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bc0a097b-0084-480c-93ac-08c6e9caf284 tempest-AttachVolumeTestJSON-1138902684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4ca9d9e-4d56-44e2-bec6-3003345cad1c" returned: 0 in 0.920s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:29:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bc0a097b-0084-480c-93ac-08c6e9caf284 tempest-AttachVolumeTestJSON-1138902684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4ca9d9e-4d56-44e2-bec6-3003345cad1c {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:29:45 devstack sudo[92358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4ca9d9e-4d56-44e2-bec6-3003345cad1c Jun 04 06:29:45 devstack sudo[92358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:29:46 devstack sudo[92358]: pam_unix(sudo:session): session closed for user root Jun 04 06:29:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bc0a097b-0084-480c-93ac-08c6e9caf284 tempest-AttachVolumeTestJSON-1138902684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4ca9d9e-4d56-44e2-bec6-3003345cad1c" returned: 0 in 0.976s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:29:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-3b3f0f67-ea57-402f-b8a5-251e48e34806 req-c21f80cf-5e0e-4b18-8e72-57a15b259762 tempest-AttachVolumeNegativeTest-499422654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:29:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-3b3f0f67-ea57-402f-b8a5-251e48e34806 req-c21f80cf-5e0e-4b18-8e72-57a15b259762 tempest-AttachVolumeNegativeTest-499422654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:29:46 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-bc0a097b-0084-480c-93ac-08c6e9caf284 tempest-AttachVolumeTestJSON-1138902684 None] Lock "cinder-quobyte-d4ca9d9e-4d56-44e2-bec6-3003345cad1c" released by "delete_volume" :: held 2.006s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:29:46 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2a6eb5-fbaa-43d4-b604-e870e8bb8da8]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:29:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-3b3f0f67-ea57-402f-b8a5-251e48e34806 req-c21f80cf-5e0e-4b18-8e72-57a15b259762 tempest-AttachVolumeNegativeTest-499422654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-493151b7-5ffa-4c77-92a1-7c09178b2036 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:29:46 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-bc0a097b-0084-480c-93ac-08c6e9caf284 tempest-AttachVolumeTestJSON-1138902684 None] Created reservations ['c3232843-3963-4462-a645-2ca5284f2a5b', '9dd61725-65b7-4929-9546-c0b2a93d6b17', '17794ccf-ad8f-4a79-9a6b-5313ee19b329', '651e4732-f497-4233-ab1b-d84103546d4a'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:29:47 devstack sudo[92384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-493151b7-5ffa-4c77-92a1-7c09178b2036 Jun 04 06:29:47 devstack sudo[92384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:29:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-bc0a097b-0084-480c-93ac-08c6e9caf284 tempest-AttachVolumeTestJSON-1138902684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:29:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-bc0a097b-0084-480c-93ac-08c6e9caf284 tempest-AttachVolumeTestJSON-1138902684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:29:47 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-bc0a097b-0084-480c-93ac-08c6e9caf284 tempest-AttachVolumeTestJSON-1138902684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:29:47 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-bc0a097b-0084-480c-93ac-08c6e9caf284 tempest-AttachVolumeTestJSON-1138902684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:29:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-bc0a097b-0084-480c-93ac-08c6e9caf284 tempest-AttachVolumeTestJSON-1138902684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:29:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bc0a097b-0084-480c-93ac-08c6e9caf284 tempest-AttachVolumeTestJSON-1138902684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:29:47 devstack sudo[92388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:29:47 devstack sudo[92388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:29:47 devstack sudo[92384]: pam_unix(sudo:session): session closed for user root Jun 04 06:29:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-3b3f0f67-ea57-402f-b8a5-251e48e34806 req-c21f80cf-5e0e-4b18-8e72-57a15b259762 tempest-AttachVolumeNegativeTest-499422654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-493151b7-5ffa-4c77-92a1-7c09178b2036" returned: 0 in 0.937s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:29:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-3b3f0f67-ea57-402f-b8a5-251e48e34806 req-c21f80cf-5e0e-4b18-8e72-57a15b259762 tempest-AttachVolumeNegativeTest-499422654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.998s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:29:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-3b3f0f67-ea57-402f-b8a5-251e48e34806 req-c21f80cf-5e0e-4b18-8e72-57a15b259762 tempest-AttachVolumeNegativeTest-499422654 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574', 'name': 'volume-493151b7-5ffa-4c77-92a1-7c09178b2036', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '25175c4b-14f5-486f-9b56-bec967626d5f', 'enforce_multipath': True} {{(pid=86069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 06:29:47 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-3b3f0f67-ea57-402f-b8a5-251e48e34806 req-c21f80cf-5e0e-4b18-8e72-57a15b259762 tempest-AttachVolumeNegativeTest-499422654 None] attachment_update completed successfully. Jun 04 06:29:47 devstack sudo[92388]: pam_unix(sudo:session): session closed for user root Jun 04 06:29:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bc0a097b-0084-480c-93ac-08c6e9caf284 tempest-AttachVolumeTestJSON-1138902684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.832s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:29:47 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-bc0a097b-0084-480c-93ac-08c6e9caf284 tempest-AttachVolumeTestJSON-1138902684 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:29:48 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-bc0a097b-0084-480c-93ac-08c6e9caf284 tempest-AttachVolumeTestJSON-1138902684 None] Deleted volume successfully. Jun 04 06:29:48 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-bc0a097b-0084-480c-93ac-08c6e9caf284 tempest-AttachVolumeTestJSON-1138902684 None] Lock "cinder-d4ca9d9e-4d56-44e2-bec6-3003345cad1c-delete_volume" released by "delete_volume" :: held 3.225s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:29:48 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0734a264-2467-411c-8584-d015e59b8b6c tempest-AttachVolumeTestJSON-1138902684 None] Acquiring lock "cinder-d7a981e3-1933-4517-b204-f01101ea69c0-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:29:48 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0734a264-2467-411c-8584-d015e59b8b6c tempest-AttachVolumeTestJSON-1138902684 None] Lock "cinder-d7a981e3-1933-4517-b204-f01101ea69c0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:29:48 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0734a264-2467-411c-8584-d015e59b8b6c tempest-AttachVolumeTestJSON-1138902684 None] Acquiring lock "cinder-quobyte-d7a981e3-1933-4517-b204-f01101ea69c0" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:29:48 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0734a264-2467-411c-8584-d015e59b8b6c tempest-AttachVolumeTestJSON-1138902684 None] Lock "cinder-quobyte-d7a981e3-1933-4517-b204-f01101ea69c0" acquired by "delete_volume" :: waited 0.025s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:29:48 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c462a42-ec3c-4d7b-88ba-de552195b865]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:29:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0734a264-2467-411c-8584-d015e59b8b6c tempest-AttachVolumeTestJSON-1138902684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d7a981e3-1933-4517-b204-f01101ea69c0 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:29:48 devstack sudo[92418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d7a981e3-1933-4517-b204-f01101ea69c0 Jun 04 06:29:48 devstack sudo[92418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:29:49 devstack sudo[92418]: pam_unix(sudo:session): session closed for user root Jun 04 06:29:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0734a264-2467-411c-8584-d015e59b8b6c tempest-AttachVolumeTestJSON-1138902684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d7a981e3-1933-4517-b204-f01101ea69c0" returned: 0 in 0.963s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:29:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0734a264-2467-411c-8584-d015e59b8b6c tempest-AttachVolumeTestJSON-1138902684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d7a981e3-1933-4517-b204-f01101ea69c0 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:29:49 devstack sudo[92783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d7a981e3-1933-4517-b204-f01101ea69c0 Jun 04 06:29:49 devstack sudo[92783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:29:50 devstack sudo[92783]: pam_unix(sudo:session): session closed for user root Jun 04 06:29:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0734a264-2467-411c-8584-d015e59b8b6c tempest-AttachVolumeTestJSON-1138902684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d7a981e3-1933-4517-b204-f01101ea69c0" returned: 0 in 0.753s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:29:50 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0734a264-2467-411c-8584-d015e59b8b6c tempest-AttachVolumeTestJSON-1138902684 None] Lock "cinder-quobyte-d7a981e3-1933-4517-b204-f01101ea69c0" released by "delete_volume" :: held 1.802s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:29:50 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-0734a264-2467-411c-8584-d015e59b8b6c tempest-AttachVolumeTestJSON-1138902684 None] Created reservations ['4657ead9-13ae-4623-950e-717da7dbd619', '608d7658-4162-4706-aa9e-806776ba29cb', '1a4498b7-4d3a-4f18-9a31-7d30c0afe6cb', 'f286bd45-72a7-4571-ae78-5e9780c89863'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:29:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0734a264-2467-411c-8584-d015e59b8b6c tempest-AttachVolumeTestJSON-1138902684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:29:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0734a264-2467-411c-8584-d015e59b8b6c tempest-AttachVolumeTestJSON-1138902684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:29:50 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0734a264-2467-411c-8584-d015e59b8b6c tempest-AttachVolumeTestJSON-1138902684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:29:50 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0734a264-2467-411c-8584-d015e59b8b6c tempest-AttachVolumeTestJSON-1138902684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:29:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0734a264-2467-411c-8584-d015e59b8b6c tempest-AttachVolumeTestJSON-1138902684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:29:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0734a264-2467-411c-8584-d015e59b8b6c tempest-AttachVolumeTestJSON-1138902684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:29:50 devstack sudo[92786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:29:50 devstack sudo[92786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:29:51 devstack sudo[92786]: pam_unix(sudo:session): session closed for user root Jun 04 06:29:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0734a264-2467-411c-8584-d015e59b8b6c tempest-AttachVolumeTestJSON-1138902684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.898s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:29:51 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-0734a264-2467-411c-8584-d015e59b8b6c tempest-AttachVolumeTestJSON-1138902684 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:29:51 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-0734a264-2467-411c-8584-d015e59b8b6c tempest-AttachVolumeTestJSON-1138902684 None] Deleted volume successfully. Jun 04 06:29:51 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0734a264-2467-411c-8584-d015e59b8b6c tempest-AttachVolumeTestJSON-1138902684 None] Lock "cinder-d7a981e3-1933-4517-b204-f01101ea69c0-delete_volume" released by "delete_volume" :: held 3.029s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:29:54 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-6e393e00-8377-4b96-95c8-db592ee3d88f req-bed931bb-48e5-4c92-b0bd-0bd2976d0a5d tempest-AttachVolumeNegativeTest-499422654 None] Terminate volume connection completed successfully. Jun 04 06:29:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-6e393e00-8377-4b96-95c8-db592ee3d88f req-bed931bb-48e5-4c92-b0bd-0bd2976d0a5d tempest-AttachVolumeNegativeTest-499422654 None] Deleting attachment 25175c4b-14f5-486f-9b56-bec967626d5f. {{(pid=86069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 06:30:00 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:30:01 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] Flow 'volume_create_manager' (fbabf6fb-039e-40f9-9b04-89da77843340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:30:01 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (027078cf-9e96-4fd0-bfde-408c8e04a8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:01 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (027078cf-9e96-4fd0-bfde-408c8e04a8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1175855090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89da37b2-03c0-4a74-a4ad-8555e719fcc7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f0b3c49cfd3b4773a8c209ad22018bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:30:01Z,use_quota=True,user_id='87970a21e9b143f1bdd11bcdf9a31b0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:30:01 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c14349b-69d9-4243-b115-9ceed1fcdcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:01 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c14349b-69d9-4243-b115-9ceed1fcdcf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:30:01 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce97722-7415-48ea-8a06-645e7ce012c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:01 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce97722-7415-48ea-8a06-645e7ce012c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89da37b2-03c0-4a74-a4ad-8555e719fcc7', 'volume_name': 'volume-89da37b2-03c0-4a74-a4ad-8555e719fcc7', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:30:01 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce42a0ce-4aa7-4ddf-bf0b-caee8b7df242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:01 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce42a0ce-4aa7-4ddf-bf0b-caee8b7df242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:30:01 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc0bc82b-77b8-40d8-93d9-63c6bf7696eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:01 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] Volume 89da37b2-03c0-4a74-a4ad-8555e719fcc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89da37b2-03c0-4a74-a4ad-8555e719fcc7', 'volume_size': 1} Jun 04 06:30:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:30:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:30:01 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1175855090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89da37b2-03c0-4a74-a4ad-8555e719fcc7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f0b3c49cfd3b4773a8c209ad22018bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:30:01Z,use_quota=True,user_id='87970a21e9b143f1bdd11bcdf9a31b0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:30:01 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] Creating volume 89da37b2-03c0-4a74-a4ad-8555e719fcc7 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:30:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:30:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:30:01 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:30:01 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:30:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:30:01 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:30:01 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:30:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-89da37b2-03c0-4a74-a4ad-8555e719fcc7 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:30:01 devstack sudo[92963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-89da37b2-03c0-4a74-a4ad-8555e719fcc7 1073741824 Jun 04 06:30:01 devstack sudo[92963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:30:03 devstack sudo[92963]: pam_unix(sudo:session): session closed for user root Jun 04 06:30:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-89da37b2-03c0-4a74-a4ad-8555e719fcc7 1073741824" returned: 0 in 1.995s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:30:03 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ea59d27c-0ebf-45b6-8589-5c4b20e7a945 tempest-VolumesActionsTest-295207613 None] Acquiring lock "cinder-9392238c-6c87-483e-9078-1ac623357ce0" by "attach_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:30:03 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ea59d27c-0ebf-45b6-8589-5c4b20e7a945 tempest-VolumesActionsTest-295207613 None] Lock "cinder-9392238c-6c87-483e-9078-1ac623357ce0" acquired by "attach_volume" :: waited 0.052s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:30:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-89da37b2-03c0-4a74-a4ad-8555e719fcc7 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:30:03 devstack sudo[92980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-89da37b2-03c0-4a74-a4ad-8555e719fcc7 Jun 04 06:30:03 devstack sudo[92980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:30:03 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-ea59d27c-0ebf-45b6-8589-5c4b20e7a945 tempest-VolumesActionsTest-295207613 None] Attaching volume 9392238c-6c87-483e-9078-1ac623357ce0 to instance 0466c88c-22ab-43fa-bc93-af0fe75669e5 at mountpoint /dev/vdb on host None. Jun 04 06:30:03 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-ea59d27c-0ebf-45b6-8589-5c4b20e7a945 tempest-VolumesActionsTest-295207613 None] Attach volume completed successfully. Jun 04 06:30:03 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ea59d27c-0ebf-45b6-8589-5c4b20e7a945 tempest-VolumesActionsTest-295207613 None] Lock "cinder-9392238c-6c87-483e-9078-1ac623357ce0" released by "attach_volume" :: held 0.223s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:30:04 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1a811e78-bf35-4a41-9332-f97f2884f1d2 tempest-VolumesActionsTest-295207613 None] Acquiring lock "cinder-9392238c-6c87-483e-9078-1ac623357ce0-detach_volume" by "detach_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:30:04 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1a811e78-bf35-4a41-9332-f97f2884f1d2 tempest-VolumesActionsTest-295207613 None] Lock "cinder-9392238c-6c87-483e-9078-1ac623357ce0-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:30:04 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-1a811e78-bf35-4a41-9332-f97f2884f1d2 tempest-VolumesActionsTest-295207613 None] Detaching volume 9392238c-6c87-483e-9078-1ac623357ce0 from instance 0466c88c-22ab-43fa-bc93-af0fe75669e5. Jun 04 06:30:04 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-1a811e78-bf35-4a41-9332-f97f2884f1d2 tempest-VolumesActionsTest-295207613 None] Detach volume completed successfully. Jun 04 06:30:04 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1a811e78-bf35-4a41-9332-f97f2884f1d2 tempest-VolumesActionsTest-295207613 None] Lock "cinder-9392238c-6c87-483e-9078-1ac623357ce0-detach_volume" released by "detach_volume" :: held 0.155s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:30:04 devstack sudo[92980]: pam_unix(sudo:session): session closed for user root Jun 04 06:30:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-89da37b2-03c0-4a74-a4ad-8555e719fcc7" returned: 0 in 1.049s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:30:04 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] <== create_volume: return (3188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:30:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.196s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:30:04 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc0bc82b-77b8-40d8-93d9-63c6bf7696eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89da37b2-03c0-4a74-a4ad-8555e719fcc7', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:30:04 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd179aa-f909-4ef8-9d28-9b61de1a5ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:04 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] Volume volume-89da37b2-03c0-4a74-a4ad-8555e719fcc7 (89da37b2-03c0-4a74-a4ad-8555e719fcc7): created successfully Jun 04 06:30:04 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd179aa-f909-4ef8-9d28-9b61de1a5ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:30:04 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] Flow 'volume_create_manager' (fbabf6fb-039e-40f9-9b04-89da77843340) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:30:04 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-d758b6c3-6cda-46d3-b14e-012b4e6a2c0e tempest-VolumesTestJSON-225906 None] Created volume successfully. Jun 04 06:30:06 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:30:06 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] Flow 'volume_create_manager' (9052e612-f313-4a03-8a97-3c4dff0c4ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:30:06 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e419e1c-904f-47e6-9893-953efa0b332b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:06 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e419e1c-904f-47e6-9893-953efa0b332b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1100315415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=697ecfdc-51cf-478a-9165-681fba05652a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f0b3c49cfd3b4773a8c209ad22018bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:30:07Z,use_quota=True,user_id='87970a21e9b143f1bdd11bcdf9a31b0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:30:06 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c9dc3d3-f3dd-49be-8433-a19301ff9081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:06 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c9dc3d3-f3dd-49be-8433-a19301ff9081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:30:06 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4271e4ca-36b4-4a6a-8a6b-0dc65f7e39cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:06 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4271e4ca-36b4-4a6a-8a6b-0dc65f7e39cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '697ecfdc-51cf-478a-9165-681fba05652a', 'volume_name': 'volume-697ecfdc-51cf-478a-9165-681fba05652a', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:30:06 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc43c3d-5b32-4f9a-bcb3-40bf1fa24048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:06 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc43c3d-5b32-4f9a-bcb3-40bf1fa24048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:30:06 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f25243-08af-4555-8387-b06973df0e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:06 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] Volume 697ecfdc-51cf-478a-9165-681fba05652a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-697ecfdc-51cf-478a-9165-681fba05652a', 'volume_size': 1} Jun 04 06:30:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:30:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:30:06 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1100315415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=697ecfdc-51cf-478a-9165-681fba05652a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f0b3c49cfd3b4773a8c209ad22018bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:30:07Z,use_quota=True,user_id='87970a21e9b143f1bdd11bcdf9a31b0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:30:06 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] Creating volume 697ecfdc-51cf-478a-9165-681fba05652a {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:30:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:30:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:30:06 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:30:06 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:30:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:30:06 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:30:06 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:30:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-697ecfdc-51cf-478a-9165-681fba05652a 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:30:06 devstack sudo[93040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-697ecfdc-51cf-478a-9165-681fba05652a 1073741824 Jun 04 06:30:06 devstack sudo[93040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:30:07 devstack sudo[93040]: pam_unix(sudo:session): session closed for user root Jun 04 06:30:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-697ecfdc-51cf-478a-9165-681fba05652a 1073741824" returned: 0 in 1.018s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:30:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-697ecfdc-51cf-478a-9165-681fba05652a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:30:07 devstack sudo[93048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-697ecfdc-51cf-478a-9165-681fba05652a Jun 04 06:30:07 devstack sudo[93048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:30:08 devstack sudo[93048]: pam_unix(sudo:session): session closed for user root Jun 04 06:30:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-697ecfdc-51cf-478a-9165-681fba05652a" returned: 0 in 0.727s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:30:08 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:30:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:30:08 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f25243-08af-4555-8387-b06973df0e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-697ecfdc-51cf-478a-9165-681fba05652a', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:30:08 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4eb48ec-2bec-4fb8-b7f9-1dd2c50aff7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:08 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] Volume volume-697ecfdc-51cf-478a-9165-681fba05652a (697ecfdc-51cf-478a-9165-681fba05652a): created successfully Jun 04 06:30:08 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4eb48ec-2bec-4fb8-b7f9-1dd2c50aff7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:30:08 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] Flow 'volume_create_manager' (9052e612-f313-4a03-8a97-3c4dff0c4ac2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:30:08 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-41ab273c-a2aa-4917-8182-f98e8ac8f090 tempest-VolumesTestJSON-225906 None] Created volume successfully. Jun 04 06:30:09 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:30:09 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] Flow 'volume_create_manager' (55890f4e-6a0f-4cbb-ac1c-62f928244299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:30:09 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77aa72f6-d564-4ce6-84ab-e195dc7f9bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:09 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77aa72f6-d564-4ce6-84ab-e195dc7f9bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1830855500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc73e8e8-3d76-45ca-bf26-a7396fabbe13,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f0b3c49cfd3b4773a8c209ad22018bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:30:09Z,use_quota=True,user_id='87970a21e9b143f1bdd11bcdf9a31b0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:30:09 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81adab1b-0a4e-42a3-878f-c2f2ed1da507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:09 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81adab1b-0a4e-42a3-878f-c2f2ed1da507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:30:09 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d694be97-1f0d-4f19-a570-2be5212b0db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:09 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d694be97-1f0d-4f19-a570-2be5212b0db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc73e8e8-3d76-45ca-bf26-a7396fabbe13', 'volume_name': 'volume-cc73e8e8-3d76-45ca-bf26-a7396fabbe13', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:30:09 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb502e1-57b4-40eb-8fcf-0984f6e566c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:09 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb502e1-57b4-40eb-8fcf-0984f6e566c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:30:09 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74453555-21d5-4a06-982b-45d90d1aff14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:09 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] Volume cc73e8e8-3d76-45ca-bf26-a7396fabbe13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc73e8e8-3d76-45ca-bf26-a7396fabbe13', 'volume_size': 1} Jun 04 06:30:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:30:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:30:09 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1830855500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc73e8e8-3d76-45ca-bf26-a7396fabbe13,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f0b3c49cfd3b4773a8c209ad22018bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:30:09Z,use_quota=True,user_id='87970a21e9b143f1bdd11bcdf9a31b0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:30:09 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] Creating volume cc73e8e8-3d76-45ca-bf26-a7396fabbe13 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:30:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:30:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:30:09 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:30:09 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:30:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:30:09 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:30:09 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:30:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cc73e8e8-3d76-45ca-bf26-a7396fabbe13 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:30:09 devstack sudo[93052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cc73e8e8-3d76-45ca-bf26-a7396fabbe13 1073741824 Jun 04 06:30:09 devstack sudo[93052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:30:10 devstack sudo[93052]: pam_unix(sudo:session): session closed for user root Jun 04 06:30:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cc73e8e8-3d76-45ca-bf26-a7396fabbe13 1073741824" returned: 0 in 0.976s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:30:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cc73e8e8-3d76-45ca-bf26-a7396fabbe13 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:30:10 devstack sudo[93062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cc73e8e8-3d76-45ca-bf26-a7396fabbe13 Jun 04 06:30:10 devstack sudo[93062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:30:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:30:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:30:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:30:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:30:11 devstack sudo[93062]: pam_unix(sudo:session): session closed for user root Jun 04 06:30:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:30:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:30:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:30:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cc73e8e8-3d76-45ca-bf26-a7396fabbe13" returned: 0 in 0.690s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:30:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:30:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:30:11 devstack sudo[93065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:30:11 devstack sudo[93065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:30:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74453555-21d5-4a06-982b-45d90d1aff14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc73e8e8-3d76-45ca-bf26-a7396fabbe13', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:30:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4db118-c8d6-44d4-99b8-ef85b784e82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:11 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] Volume volume-cc73e8e8-3d76-45ca-bf26-a7396fabbe13 (cc73e8e8-3d76-45ca-bf26-a7396fabbe13): created successfully Jun 04 06:30:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4db118-c8d6-44d4-99b8-ef85b784e82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:30:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] Flow 'volume_create_manager' (55890f4e-6a0f-4cbb-ac1c-62f928244299) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:30:11 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-a018654f-e9ce-4438-9c5d-d8a186434473 tempest-VolumesTestJSON-225906 None] Created volume successfully. Jun 04 06:30:12 devstack sudo[93065]: pam_unix(sudo:session): session closed for user root Jun 04 06:30:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.946s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:30:12 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:30:12 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager._thread_info {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:30:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread count: 8 {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 06:30:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread info: [<_MainThread(MainThread, started 131797370544256)>, , , , , , , ] {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 06:30:13 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-51f5e966-2ad9-4717-a666-63dbdb5c6a11 tempest-VolumesTestJSON-225906 None] Acquiring lock "cinder-cc73e8e8-3d76-45ca-bf26-a7396fabbe13-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:30:13 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-51f5e966-2ad9-4717-a666-63dbdb5c6a11 tempest-VolumesTestJSON-225906 None] Lock "cinder-cc73e8e8-3d76-45ca-bf26-a7396fabbe13-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:30:13 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-51f5e966-2ad9-4717-a666-63dbdb5c6a11 tempest-VolumesTestJSON-225906 None] Acquiring lock "cinder-quobyte-cc73e8e8-3d76-45ca-bf26-a7396fabbe13" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:30:13 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-51f5e966-2ad9-4717-a666-63dbdb5c6a11 tempest-VolumesTestJSON-225906 None] Lock "cinder-quobyte-cc73e8e8-3d76-45ca-bf26-a7396fabbe13" acquired by "delete_volume" :: waited 0.021s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:30:13 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a333725-2aa4-44bc-8cc5-d58151ff692c]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:30:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-51f5e966-2ad9-4717-a666-63dbdb5c6a11 tempest-VolumesTestJSON-225906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cc73e8e8-3d76-45ca-bf26-a7396fabbe13 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:30:13 devstack sudo[93134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cc73e8e8-3d76-45ca-bf26-a7396fabbe13 Jun 04 06:30:13 devstack sudo[93134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:30:14 devstack sudo[93134]: pam_unix(sudo:session): session closed for user root Jun 04 06:30:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-51f5e966-2ad9-4717-a666-63dbdb5c6a11 tempest-VolumesTestJSON-225906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cc73e8e8-3d76-45ca-bf26-a7396fabbe13" returned: 0 in 1.122s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:30:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-51f5e966-2ad9-4717-a666-63dbdb5c6a11 tempest-VolumesTestJSON-225906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cc73e8e8-3d76-45ca-bf26-a7396fabbe13 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:30:14 devstack sudo[93139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cc73e8e8-3d76-45ca-bf26-a7396fabbe13 Jun 04 06:30:14 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:30:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8bfd5e83-d18a-439f-81af-9fa8afde9956 tempest-VolumesActionsTest-295207613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:30:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8bfd5e83-d18a-439f-81af-9fa8afde9956 tempest-VolumesActionsTest-295207613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:30:15 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbadaa6-dd1c-403e-8756-4c5d1715c390]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:30:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8bfd5e83-d18a-439f-81af-9fa8afde9956 tempest-VolumesActionsTest-295207613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:30:15 devstack sudo[93142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0 Jun 04 06:30:15 devstack sudo[93142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:30:15 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root Jun 04 06:30:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-51f5e966-2ad9-4717-a666-63dbdb5c6a11 tempest-VolumesTestJSON-225906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cc73e8e8-3d76-45ca-bf26-a7396fabbe13" returned: 0 in 0.772s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:30:15 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-51f5e966-2ad9-4717-a666-63dbdb5c6a11 tempest-VolumesTestJSON-225906 None] Lock "cinder-quobyte-cc73e8e8-3d76-45ca-bf26-a7396fabbe13" released by "delete_volume" :: held 1.972s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:30:15 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-51f5e966-2ad9-4717-a666-63dbdb5c6a11 tempest-VolumesTestJSON-225906 None] Created reservations ['6b3cbfd1-0f27-4b18-8064-7b205bb52aca', '0b27a095-496a-4c01-8bbc-aa77d28dc334', '44887ca1-e9e8-423c-9d99-a8d82160da53', 'c2bdd355-c522-460f-a605-a491eeb9013b'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:30:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-51f5e966-2ad9-4717-a666-63dbdb5c6a11 tempest-VolumesTestJSON-225906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:30:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-51f5e966-2ad9-4717-a666-63dbdb5c6a11 tempest-VolumesTestJSON-225906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:30:15 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-51f5e966-2ad9-4717-a666-63dbdb5c6a11 tempest-VolumesTestJSON-225906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:30:15 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-51f5e966-2ad9-4717-a666-63dbdb5c6a11 tempest-VolumesTestJSON-225906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:30:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-51f5e966-2ad9-4717-a666-63dbdb5c6a11 tempest-VolumesTestJSON-225906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:30:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-51f5e966-2ad9-4717-a666-63dbdb5c6a11 tempest-VolumesTestJSON-225906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:30:15 devstack sudo[93145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:30:15 devstack sudo[93145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:30:15 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-229b67ac-151f-4ecf-9044-ec856abf870a tempest-VolumesTestJSON-225906 None] Acquiring lock "cinder-697ecfdc-51cf-478a-9165-681fba05652a-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:30:16 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-229b67ac-151f-4ecf-9044-ec856abf870a tempest-VolumesTestJSON-225906 None] Lock "cinder-697ecfdc-51cf-478a-9165-681fba05652a-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:30:16 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-229b67ac-151f-4ecf-9044-ec856abf870a tempest-VolumesTestJSON-225906 None] Acquiring lock "cinder-quobyte-697ecfdc-51cf-478a-9165-681fba05652a" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:30:16 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-229b67ac-151f-4ecf-9044-ec856abf870a tempest-VolumesTestJSON-225906 None] Lock "cinder-quobyte-697ecfdc-51cf-478a-9165-681fba05652a" acquired by "delete_volume" :: waited 0.033s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:30:16 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5761439-7449-488d-b01f-ec6763862ead]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:30:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-229b67ac-151f-4ecf-9044-ec856abf870a tempest-VolumesTestJSON-225906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-697ecfdc-51cf-478a-9165-681fba05652a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:30:16 devstack sudo[93149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-697ecfdc-51cf-478a-9165-681fba05652a Jun 04 06:30:16 devstack sudo[93149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:30:16 devstack sudo[93142]: pam_unix(sudo:session): session closed for user root Jun 04 06:30:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8bfd5e83-d18a-439f-81af-9fa8afde9956 tempest-VolumesActionsTest-295207613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0" returned: 0 in 1.223s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:30:16 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b16db88-40bf-41f4-82c5-7f011290467e]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:30:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8bfd5e83-d18a-439f-81af-9fa8afde9956 tempest-VolumesActionsTest-295207613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:30:16 devstack sudo[93145]: pam_unix(sudo:session): session closed for user root Jun 04 06:30:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-51f5e966-2ad9-4717-a666-63dbdb5c6a11 tempest-VolumesTestJSON-225906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.905s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:30:16 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-51f5e966-2ad9-4717-a666-63dbdb5c6a11 tempest-VolumesTestJSON-225906 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:30:16 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-51f5e966-2ad9-4717-a666-63dbdb5c6a11 tempest-VolumesTestJSON-225906 None] Deleted volume successfully. Jun 04 06:30:16 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-51f5e966-2ad9-4717-a666-63dbdb5c6a11 tempest-VolumesTestJSON-225906 None] Lock "cinder-cc73e8e8-3d76-45ca-bf26-a7396fabbe13-delete_volume" released by "delete_volume" :: held 3.179s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:30:16 devstack sudo[93154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0 Jun 04 06:30:16 devstack sudo[93154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:30:17 devstack sudo[93149]: pam_unix(sudo:session): session closed for user root Jun 04 06:30:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-229b67ac-151f-4ecf-9044-ec856abf870a tempest-VolumesTestJSON-225906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-697ecfdc-51cf-478a-9165-681fba05652a" returned: 0 in 1.084s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:30:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-229b67ac-151f-4ecf-9044-ec856abf870a tempest-VolumesTestJSON-225906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-697ecfdc-51cf-478a-9165-681fba05652a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:30:17 devstack sudo[93159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-697ecfdc-51cf-478a-9165-681fba05652a Jun 04 06:30:17 devstack sudo[93159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:30:17 devstack sudo[93154]: pam_unix(sudo:session): session closed for user root Jun 04 06:30:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8bfd5e83-d18a-439f-81af-9fa8afde9956 tempest-VolumesActionsTest-295207613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0" returned: 0 in 1.140s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:30:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8bfd5e83-d18a-439f-81af-9fa8afde9956 tempest-VolumesActionsTest-295207613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0 /opt/stack/data/cinder/conversion/9392238c-6c87-483e-9078-1ac623357ce0.temp_image.ed55e1ff-5485-4aa7-bc28-2c8c2f86b08alw5yxrlf.img {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:30:17 devstack sudo[93164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0 /opt/stack/data/cinder/conversion/9392238c-6c87-483e-9078-1ac623357ce0.temp_image.ed55e1ff-5485-4aa7-bc28-2c8c2f86b08alw5yxrlf.img Jun 04 06:30:17 devstack sudo[93164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:30:18 devstack sudo[93159]: pam_unix(sudo:session): session closed for user root Jun 04 06:30:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-229b67ac-151f-4ecf-9044-ec856abf870a tempest-VolumesTestJSON-225906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-697ecfdc-51cf-478a-9165-681fba05652a" returned: 0 in 1.200s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:30:18 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-229b67ac-151f-4ecf-9044-ec856abf870a tempest-VolumesTestJSON-225906 None] Lock "cinder-quobyte-697ecfdc-51cf-478a-9165-681fba05652a" released by "delete_volume" :: held 2.407s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:30:18 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-229b67ac-151f-4ecf-9044-ec856abf870a tempest-VolumesTestJSON-225906 None] Created reservations ['59b0584f-8396-4ee8-b137-d0a986991c72', 'ee82c3f1-0c02-4623-a920-f7d12da70a89', 'c9c3630f-fdee-4fa4-97b6-7b2607797974', '1e33a4b4-f902-41d8-a821-fd174b5cb8e3'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:30:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-229b67ac-151f-4ecf-9044-ec856abf870a tempest-VolumesTestJSON-225906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:30:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-229b67ac-151f-4ecf-9044-ec856abf870a tempest-VolumesTestJSON-225906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:30:18 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-229b67ac-151f-4ecf-9044-ec856abf870a tempest-VolumesTestJSON-225906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:30:18 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-229b67ac-151f-4ecf-9044-ec856abf870a tempest-VolumesTestJSON-225906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:30:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-229b67ac-151f-4ecf-9044-ec856abf870a tempest-VolumesTestJSON-225906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:30:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-229b67ac-151f-4ecf-9044-ec856abf870a tempest-VolumesTestJSON-225906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:30:18 devstack sudo[93172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:30:18 devstack sudo[93172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:30:19 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-5c11f369-7996-45a8-8f30-b9ac0178447b tempest-VolumesTestJSON-225906 None] Acquiring lock "cinder-89da37b2-03c0-4a74-a4ad-8555e719fcc7-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:30:19 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-5c11f369-7996-45a8-8f30-b9ac0178447b tempest-VolumesTestJSON-225906 None] Lock "cinder-89da37b2-03c0-4a74-a4ad-8555e719fcc7-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:30:19 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-5c11f369-7996-45a8-8f30-b9ac0178447b tempest-VolumesTestJSON-225906 None] Acquiring lock "cinder-quobyte-89da37b2-03c0-4a74-a4ad-8555e719fcc7" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:30:20 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-5c11f369-7996-45a8-8f30-b9ac0178447b tempest-VolumesTestJSON-225906 None] Lock "cinder-quobyte-89da37b2-03c0-4a74-a4ad-8555e719fcc7" acquired by "delete_volume" :: waited 0.119s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:30:20 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[36250652-8e02-4b9f-a36a-a1cd291e7e52]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:30:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5c11f369-7996-45a8-8f30-b9ac0178447b tempest-VolumesTestJSON-225906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-89da37b2-03c0-4a74-a4ad-8555e719fcc7 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:30:20 devstack sudo[93186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-89da37b2-03c0-4a74-a4ad-8555e719fcc7 Jun 04 06:30:20 devstack sudo[93186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:30:21 devstack sudo[93172]: pam_unix(sudo:session): session closed for user root Jun 04 06:30:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-229b67ac-151f-4ecf-9044-ec856abf870a tempest-VolumesTestJSON-225906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 2.630s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:30:21 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-229b67ac-151f-4ecf-9044-ec856abf870a tempest-VolumesTestJSON-225906 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:30:21 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-229b67ac-151f-4ecf-9044-ec856abf870a tempest-VolumesTestJSON-225906 None] Deleted volume successfully. Jun 04 06:30:21 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-229b67ac-151f-4ecf-9044-ec856abf870a tempest-VolumesTestJSON-225906 None] Lock "cinder-697ecfdc-51cf-478a-9165-681fba05652a-delete_volume" released by "delete_volume" :: held 5.538s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:30:23 devstack sudo[93186]: pam_unix(sudo:session): session closed for user root Jun 04 06:30:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5c11f369-7996-45a8-8f30-b9ac0178447b tempest-VolumesTestJSON-225906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-89da37b2-03c0-4a74-a4ad-8555e719fcc7" returned: 0 in 3.011s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:30:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5c11f369-7996-45a8-8f30-b9ac0178447b tempest-VolumesTestJSON-225906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-89da37b2-03c0-4a74-a4ad-8555e719fcc7 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:30:23 devstack sudo[93239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-89da37b2-03c0-4a74-a4ad-8555e719fcc7 Jun 04 06:30:23 devstack sudo[93239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:30:25 devstack sudo[93239]: pam_unix(sudo:session): session closed for user root Jun 04 06:30:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5c11f369-7996-45a8-8f30-b9ac0178447b tempest-VolumesTestJSON-225906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-89da37b2-03c0-4a74-a4ad-8555e719fcc7" returned: 0 in 2.042s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:30:25 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-5c11f369-7996-45a8-8f30-b9ac0178447b tempest-VolumesTestJSON-225906 None] Lock "cinder-quobyte-89da37b2-03c0-4a74-a4ad-8555e719fcc7" released by "delete_volume" :: held 5.244s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:30:25 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-5c11f369-7996-45a8-8f30-b9ac0178447b tempest-VolumesTestJSON-225906 None] Created reservations ['ab5d6992-1b5a-4f95-9959-f7eac6c23dae', 'e0e669fb-fac0-4598-baa2-3974b5be56c4', 'fb6bd2c5-0396-41cf-ac0b-f9bb94f91d14', 'ae634ad1-bb55-4fc0-bb39-77cc349a4f91'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:30:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5c11f369-7996-45a8-8f30-b9ac0178447b tempest-VolumesTestJSON-225906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:30:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5c11f369-7996-45a8-8f30-b9ac0178447b tempest-VolumesTestJSON-225906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:30:25 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5c11f369-7996-45a8-8f30-b9ac0178447b tempest-VolumesTestJSON-225906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:30:25 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5c11f369-7996-45a8-8f30-b9ac0178447b tempest-VolumesTestJSON-225906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:30:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5c11f369-7996-45a8-8f30-b9ac0178447b tempest-VolumesTestJSON-225906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:30:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5c11f369-7996-45a8-8f30-b9ac0178447b tempest-VolumesTestJSON-225906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:30:25 devstack sudo[93246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:30:25 devstack sudo[93246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:30:26 devstack sudo[93164]: pam_unix(sudo:session): session closed for user root Jun 04 06:30:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8bfd5e83-d18a-439f-81af-9fa8afde9956 tempest-VolumesActionsTest-295207613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0 /opt/stack/data/cinder/conversion/9392238c-6c87-483e-9078-1ac623357ce0.temp_image.ed55e1ff-5485-4aa7-bc28-2c8c2f86b08alw5yxrlf.img" returned: 0 in 9.143s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:30:26 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d27b933-c299-4c36-bd34-7fabd0d7d13d]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:30:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8bfd5e83-d18a-439f-81af-9fa8afde9956 tempest-VolumesActionsTest-295207613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:30:27 devstack sudo[93274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0 Jun 04 06:30:27 devstack sudo[93274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:30:27 devstack sudo[93246]: pam_unix(sudo:session): session closed for user root Jun 04 06:30:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5c11f369-7996-45a8-8f30-b9ac0178447b tempest-VolumesTestJSON-225906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.456s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:30:27 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-5c11f369-7996-45a8-8f30-b9ac0178447b tempest-VolumesTestJSON-225906 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:30:27 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-5c11f369-7996-45a8-8f30-b9ac0178447b tempest-VolumesTestJSON-225906 None] Deleted volume successfully. Jun 04 06:30:27 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=61,cinder:INSERT=19,cinder:UPDATE=75,cinder:DELETE=7 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:30:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-5c11f369-7996-45a8-8f30-b9ac0178447b tempest-VolumesTestJSON-225906 None] Lock "cinder-89da37b2-03c0-4a74-a4ad-8555e719fcc7-delete_volume" released by "delete_volume" :: held 7.419s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:30:27 devstack sudo[93274]: pam_unix(sudo:session): session closed for user root Jun 04 06:30:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8bfd5e83-d18a-439f-81af-9fa8afde9956 tempest-VolumesActionsTest-295207613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0" returned: 0 in 0.990s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:30:27 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-8bfd5e83-d18a-439f-81af-9fa8afde9956 tempest-VolumesActionsTest-295207613 None] Image conversion details: src /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0, size 1024.00 MB, duration 9.14 sec, destination /opt/stack/data/cinder/conversion/9392238c-6c87-483e-9078-1ac623357ce0.temp_image.ed55e1ff-5485-4aa7-bc28-2c8c2f86b08alw5yxrlf.img {{(pid=86069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 06:30:27 devstack cinder-volume[86069]: INFO cinder.image.image_utils [None req-8bfd5e83-d18a-439f-81af-9fa8afde9956 tempest-VolumesActionsTest-295207613 None] Converted 1024.00 MB image at 111.99 MB/s Jun 04 06:30:27 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-8bfd5e83-d18a-439f-81af-9fa8afde9956 tempest-VolumesActionsTest-295207613 None] ed55e1ff-5485-4aa7-bc28-2c8c2f86b08a was raw, no need to convert to raw {{(pid=86069) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 04 06:30:35 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=55,cinder:UPDATE=68,cinder:INSERT=15,cinder:DELETE=4 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:30:37 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=2 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:30:38 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-32d0a937-6ce1-4ac1-8090-85c5326a6964 tempest-GroupSnapshotsV319Test-28590518 None] Group tempest-GroupSnapshotsV319Test-Group-1155303048: creating Jun 04 06:30:38 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-32d0a937-6ce1-4ac1-8090-85c5326a6964 tempest-GroupSnapshotsV319Test-28590518 None] Group tempest-GroupSnapshotsV319Test-Group-1155303048: created successfully Jun 04 06:30:38 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-32d0a937-6ce1-4ac1-8090-85c5326a6964 tempest-GroupSnapshotsV319Test-28590518 None] Create group completed successfully. Jun 04 06:30:39 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:30:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] Flow 'volume_create_manager' (b648655b-9e71-47f3-8e30-56bf130f253f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:30:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9dd6b66-d365-4248-bfdd-51f90d04a2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9dd6b66-d365-4248-bfdd-51f90d04a2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1819521919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b48fe95-fd69-4e4b-8baa-18f7de8c1b11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12687ec143d84bd48a875bee1df20a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:30:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:30:39Z,use_quota=True,user_id='4631ffa6fef34fbc8a35d0a629dcc24f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:30:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3759247e-255f-4790-aecc-cd6206dfed59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3759247e-255f-4790-aecc-cd6206dfed59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:30:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85727984-d3b5-4268-8461-35a59997adef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85727984-d3b5-4268-8461-35a59997adef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b48fe95-fd69-4e4b-8baa-18f7de8c1b11', 'volume_name': 'volume-0b48fe95-fd69-4e4b-8baa-18f7de8c1b11', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:30:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e105cc6-cc2a-416d-87ee-2db578cfd466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e105cc6-cc2a-416d-87ee-2db578cfd466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:30:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d54d3b9-df56-466a-95cd-7e290e0ce735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:39 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] Volume 0b48fe95-fd69-4e4b-8baa-18f7de8c1b11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b48fe95-fd69-4e4b-8baa-18f7de8c1b11', 'volume_size': 1} Jun 04 06:30:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:30:39 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:30:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] Flow 'volume_create_manager' (8500652b-f7f7-47cd-b374-c85bc51bbfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:30:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f90bc0a-cd9b-430a-aa68-565c78642835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f90bc0a-cd9b-430a-aa68-565c78642835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1600934208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=39dea030-27a5-4218-aee3-557a65a5543e,host='devstack@QuobyteHD#QuobyteHD',id=45b4c3be-7969-4ad9-a892-69adc40c0f4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='908da6f33c2e48629e2b6e15f9befb0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:30:40Z,use_quota=True,user_id='b95b9f6ee9fb4049ad3b7d60a5635cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aec6f2d9-df68-4cd5-bf21-cc1045dd5224),volume_type_id=aec6f2d9-df68-4cd5-bf21-cc1045dd5224)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:30:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bcfcf62-95b0-4f1f-9edc-ae30aa86b18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:40 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bcfcf62-95b0-4f1f-9edc-ae30aa86b18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:30:40 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c711ec2c-48cf-41cc-af9b-363ad2881c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:40 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c711ec2c-48cf-41cc-af9b-363ad2881c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45b4c3be-7969-4ad9-a892-69adc40c0f4b', 'volume_name': 'volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:30:40 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42d2169d-5028-4851-a9a9-d2213c58880e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:40 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42d2169d-5028-4851-a9a9-d2213c58880e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:30:40 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce8bf8b0-5bae-44c6-bf9b-f52c28a71eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:40 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] Volume 45b4c3be-7969-4ad9-a892-69adc40c0f4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b', 'volume_size': 1} Jun 04 06:30:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:30:49 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=3 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:30:49 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=4,cinder:UPDATE=4 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:30:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8bfd5e83-d18a-439f-81af-9fa8afde9956 tempest-VolumesActionsTest-295207613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 38.532s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:30:53 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8bfd5e83-d18a-439f-81af-9fa8afde9956 tempest-VolumesActionsTest-295207613 None] Uploaded volume to glance image-id: ed55e1ff-5485-4aa7-bc28-2c8c2f86b08a. {{(pid=86069) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1782}} Jun 04 06:30:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.323s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:30:53 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1819521919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b48fe95-fd69-4e4b-8baa-18f7de8c1b11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12687ec143d84bd48a875bee1df20a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:30:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:30:39Z,use_quota=True,user_id='4631ffa6fef34fbc8a35d0a629dcc24f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:30:53 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] Creating volume 0b48fe95-fd69-4e4b-8baa-18f7de8c1b11 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:30:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:30:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:30:53 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:30:53 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:30:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:30:53 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:30:53 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:30:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0b48fe95-fd69-4e4b-8baa-18f7de8c1b11 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:30:53 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-8bfd5e83-d18a-439f-81af-9fa8afde9956 tempest-VolumesActionsTest-295207613 None] Copy volume to image completed successfully. Jun 04 06:30:53 devstack sudo[93420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0b48fe95-fd69-4e4b-8baa-18f7de8c1b11 1073741824 Jun 04 06:30:53 devstack sudo[93420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:30:54 devstack sudo[93420]: pam_unix(sudo:session): session closed for user root Jun 04 06:30:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0b48fe95-fd69-4e4b-8baa-18f7de8c1b11 1073741824" returned: 0 in 0.980s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:30:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0b48fe95-fd69-4e4b-8baa-18f7de8c1b11 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:30:54 devstack sudo[93427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0b48fe95-fd69-4e4b-8baa-18f7de8c1b11 Jun 04 06:30:54 devstack sudo[93427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:30:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9ce5e4c2-5f21-46b0-9b50-ed68cda35314 tempest-VolumesActionsTest-295207613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:30:55 devstack sudo[93427]: pam_unix(sudo:session): session closed for user root Jun 04 06:30:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0b48fe95-fd69-4e4b-8baa-18f7de8c1b11" returned: 0 in 0.779s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:30:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] <== create_volume: return (1804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:30:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.808s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:30:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.685s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:30:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=39dea030-27a5-4218-aee3-557a65a5543e,created_at=2026-06-04T04:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1600934208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=39dea030-27a5-4218-aee3-557a65a5543e,host='devstack@QuobyteHD#QuobyteHD',id=45b4c3be-7969-4ad9-a892-69adc40c0f4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='908da6f33c2e48629e2b6e15f9befb0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:30:40Z,use_quota=True,user_id='b95b9f6ee9fb4049ad3b7d60a5635cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aec6f2d9-df68-4cd5-bf21-cc1045dd5224),volume_type_id=aec6f2d9-df68-4cd5-bf21-cc1045dd5224)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:30:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] Creating volume 45b4c3be-7969-4ad9-a892-69adc40c0f4b {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:30:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:30:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:30:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:30:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:30:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:30:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:30:55 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:30:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:30:55 devstack sudo[93466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b 1073741824 Jun 04 06:30:55 devstack sudo[93466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:30:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d54d3b9-df56-466a-95cd-7e290e0ce735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b48fe95-fd69-4e4b-8baa-18f7de8c1b11', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:30:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33bf1af4-80e3-4b25-9570-c3eae81da8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:55 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] Volume volume-0b48fe95-fd69-4e4b-8baa-18f7de8c1b11 (0b48fe95-fd69-4e4b-8baa-18f7de8c1b11): created successfully Jun 04 06:30:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33bf1af4-80e3-4b25-9570-c3eae81da8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:30:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] Flow 'volume_create_manager' (b648655b-9e71-47f3-8e30-56bf130f253f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:30:55 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-63c84bf8-b4b4-473d-9f94-bfa241a791e6 tempest-ServerActionsTestOtherA-1981488141 None] Created volume successfully. Jun 04 06:30:56 devstack sudo[93466]: pam_unix(sudo:session): session closed for user root Jun 04 06:30:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b 1073741824" returned: 0 in 1.029s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:30:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:30:56 devstack sudo[93475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b Jun 04 06:30:56 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:30:57 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root Jun 04 06:30:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b" returned: 0 in 0.815s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:30:57 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] <== create_volume: return (1889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:30:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.893s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:30:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9ce5e4c2-5f21-46b0-9b50-ed68cda35314 tempest-VolumesActionsTest-295207613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.198s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:30:57 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46b0624-df96-455b-bbe9-699daababd87]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:30:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9ce5e4c2-5f21-46b0-9b50-ed68cda35314 tempest-VolumesActionsTest-295207613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:30:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce8bf8b0-5bae-44c6-bf9b-f52c28a71eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:30:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb0bac2-ce7c-4219-a76d-c862e7a4daaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:57 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] Volume volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b (45b4c3be-7969-4ad9-a892-69adc40c0f4b): created successfully Jun 04 06:30:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb0bac2-ce7c-4219-a76d-c862e7a4daaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:30:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] Flow 'volume_create_manager' (8500652b-f7f7-47cd-b374-c85bc51bbfec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:30:57 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-f26df808-befa-4d87-b47f-e998281de11d tempest-GroupSnapshotsV319Test-28590518 None] Created volume successfully. Jun 04 06:30:57 devstack sudo[93480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0 Jun 04 06:30:57 devstack sudo[93480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:30:57 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:30:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] Flow 'volume_create_manager' (12dd42e3-2beb-4bbb-ac70-b38020bc656e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:30:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df91d80-e8ea-445e-a55e-1ef3b356e1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df91d80-e8ea-445e-a55e-1ef3b356e1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-977402118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24563fc-a785-4b42-af32-872643efe470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bdde5be5eff46e9b943f720e48197c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:30:58Z,use_quota=True,user_id='33c0a4d7c711403b820f5d41828a613c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:30:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6449385c-9187-4f51-9db2-406fb7ef2df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6449385c-9187-4f51-9db2-406fb7ef2df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:30:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e727f1ce-d821-4174-b43b-454687a876ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e727f1ce-d821-4174-b43b-454687a876ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b24563fc-a785-4b42-af32-872643efe470', 'volume_name': 'volume-b24563fc-a785-4b42-af32-872643efe470', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:30:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb55020-fdc7-4ff4-97f2-0df9a5972961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb55020-fdc7-4ff4-97f2-0df9a5972961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:30:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (529232ea-747b-44d9-95f8-6b470caa2f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:30:57 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] Volume b24563fc-a785-4b42-af32-872643efe470: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b24563fc-a785-4b42-af32-872643efe470', 'volume_size': 1} Jun 04 06:30:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:30:58 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-857d9511-2634-484c-95f7-6228de29f58e tempest-GroupSnapshotsV319Test-28590518 None] GroupSnapshot 81e11dc7-0344-42e1-92e1-5336ae246879: creating. Jun 04 06:30:58 devstack sudo[93480]: pam_unix(sudo:session): session closed for user root Jun 04 06:30:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9ce5e4c2-5f21-46b0-9b50-ed68cda35314 tempest-VolumesActionsTest-295207613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0" returned: 0 in 0.937s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:30:58 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-857d9511-2634-484c-95f7-6228de29f58e tempest-GroupSnapshotsV319Test-28590518 None] Group snapshot 81e11dc7-0344-42e1-92e1-5336ae246879: creating. {{(pid=86069) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Jun 04 06:30:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-857d9511-2634-484c-95f7-6228de29f58e tempest-GroupSnapshotsV319Test-28590518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:30:58 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85ae841-8d5d-49c4-ace9-7470484ae57d]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:30:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9ce5e4c2-5f21-46b0-9b50-ed68cda35314 tempest-VolumesActionsTest-295207613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:30:58 devstack sudo[93486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0 Jun 04 06:30:58 devstack sudo[93486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:30:59 devstack sudo[93486]: pam_unix(sudo:session): session closed for user root Jun 04 06:30:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9ce5e4c2-5f21-46b0-9b50-ed68cda35314 tempest-VolumesActionsTest-295207613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0" returned: 0 in 0.931s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:30:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9ce5e4c2-5f21-46b0-9b50-ed68cda35314 tempest-VolumesActionsTest-295207613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0 /opt/stack/data/cinder/conversion/9392238c-6c87-483e-9078-1ac623357ce0.temp_image.8961971d-6b2c-416e-808e-39aa12dbbe7csmqj5hh9.img {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:30:59 devstack sudo[93491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0 /opt/stack/data/cinder/conversion/9392238c-6c87-483e-9078-1ac623357ce0.temp_image.8961971d-6b2c-416e-808e-39aa12dbbe7csmqj5hh9.img Jun 04 06:30:59 devstack sudo[93491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:06 devstack sudo[93491]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9ce5e4c2-5f21-46b0-9b50-ed68cda35314 tempest-VolumesActionsTest-295207613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0 /opt/stack/data/cinder/conversion/9392238c-6c87-483e-9078-1ac623357ce0.temp_image.8961971d-6b2c-416e-808e-39aa12dbbe7csmqj5hh9.img" returned: 0 in 6.744s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:06 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[67db75b3-784d-4557-8a0c-64f6bef5278a]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:31:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9ce5e4c2-5f21-46b0-9b50-ed68cda35314 tempest-VolumesActionsTest-295207613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:06 devstack sudo[93530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0 Jun 04 06:31:06 devstack sudo[93530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:07 devstack sudo[93530]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9ce5e4c2-5f21-46b0-9b50-ed68cda35314 tempest-VolumesActionsTest-295207613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0" returned: 0 in 0.962s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:07 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-9ce5e4c2-5f21-46b0-9b50-ed68cda35314 tempest-VolumesActionsTest-295207613 None] Image conversion details: src /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0, size 1024.00 MB, duration 6.75 sec, destination /opt/stack/data/cinder/conversion/9392238c-6c87-483e-9078-1ac623357ce0.temp_image.8961971d-6b2c-416e-808e-39aa12dbbe7csmqj5hh9.img {{(pid=86069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 06:31:07 devstack cinder-volume[86069]: INFO cinder.image.image_utils [None req-9ce5e4c2-5f21-46b0-9b50-ed68cda35314 tempest-VolumesActionsTest-295207613 None] Converted 1024.00 MB image at 151.81 MB/s Jun 04 06:31:07 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-9ce5e4c2-5f21-46b0-9b50-ed68cda35314 tempest-VolumesActionsTest-295207613 None] 8961971d-6b2c-416e-808e-39aa12dbbe7c was raw, converting to qcow2 {{(pid=86069) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 04 06:31:07 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d1e4b0-31fa-47b2-af88-35aedeeb701d]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:31:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9ce5e4c2-5f21-46b0-9b50-ed68cda35314 tempest-VolumesActionsTest-295207613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9392238c-6c87-483e-9078-1ac623357ce0.temp_image.8961971d-6b2c-416e-808e-39aa12dbbe7csmqj5hh9.img {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:07 devstack sudo[93537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9392238c-6c87-483e-9078-1ac623357ce0.temp_image.8961971d-6b2c-416e-808e-39aa12dbbe7csmqj5hh9.img Jun 04 06:31:07 devstack sudo[93537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:08 devstack sudo[93537]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9ce5e4c2-5f21-46b0-9b50-ed68cda35314 tempest-VolumesActionsTest-295207613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9392238c-6c87-483e-9078-1ac623357ce0.temp_image.8961971d-6b2c-416e-808e-39aa12dbbe7csmqj5hh9.img" returned: 0 in 0.828s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9ce5e4c2-5f21-46b0-9b50-ed68cda35314 tempest-VolumesActionsTest-295207613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9392238c-6c87-483e-9078-1ac623357ce0.temp_image.8961971d-6b2c-416e-808e-39aa12dbbe7csmqj5hh9.img {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:08 devstack sudo[93541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9392238c-6c87-483e-9078-1ac623357ce0.temp_image.8961971d-6b2c-416e-808e-39aa12dbbe7csmqj5hh9.img Jun 04 06:31:08 devstack sudo[93541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:08 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:UPDATE=5,cinder:DELETE=2,cinder:SELECT=4 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:31:08 devstack sudo[93541]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9ce5e4c2-5f21-46b0-9b50-ed68cda35314 tempest-VolumesActionsTest-295207613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9392238c-6c87-483e-9078-1ac623357ce0.temp_image.8961971d-6b2c-416e-808e-39aa12dbbe7csmqj5hh9.img" returned: 1 in 0.718s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9ce5e4c2-5f21-46b0-9b50-ed68cda35314 tempest-VolumesActionsTest-295207613 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9392238c-6c87-483e-9078-1ac623357ce0.temp_image.8961971d-6b2c-416e-808e-39aa12dbbe7csmqj5hh9.img' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:31:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9ce5e4c2-5f21-46b0-9b50-ed68cda35314 tempest-VolumesActionsTest-295207613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9392238c-6c87-483e-9078-1ac623357ce0.temp_image.8961971d-6b2c-416e-808e-39aa12dbbe7csmqj5hh9.img /opt/stack/data/cinder/conversion/vol_upload_ar80e36y {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:08 devstack sudo[93546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9392238c-6c87-483e-9078-1ac623357ce0.temp_image.8961971d-6b2c-416e-808e-39aa12dbbe7csmqj5hh9.img /opt/stack/data/cinder/conversion/vol_upload_ar80e36y Jun 04 06:31:08 devstack sudo[93546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:09 devstack sudo[93546]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9ce5e4c2-5f21-46b0-9b50-ed68cda35314 tempest-VolumesActionsTest-295207613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9392238c-6c87-483e-9078-1ac623357ce0.temp_image.8961971d-6b2c-416e-808e-39aa12dbbe7csmqj5hh9.img /opt/stack/data/cinder/conversion/vol_upload_ar80e36y" returned: 0 in 0.661s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:09 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-9ce5e4c2-5f21-46b0-9b50-ed68cda35314 tempest-VolumesActionsTest-295207613 None] Image conversion details: src /opt/stack/data/cinder/conversion/9392238c-6c87-483e-9078-1ac623357ce0.temp_image.8961971d-6b2c-416e-808e-39aa12dbbe7csmqj5hh9.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ar80e36y {{(pid=86069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 06:31:09 devstack cinder-volume[86069]: INFO cinder.image.image_utils [None req-9ce5e4c2-5f21-46b0-9b50-ed68cda35314 tempest-VolumesActionsTest-295207613 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 04 06:31:09 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4a5f25-017e-421d-a8fa-c9a9805ac23c]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:31:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9ce5e4c2-5f21-46b0-9b50-ed68cda35314 tempest-VolumesActionsTest-295207613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ar80e36y {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:09 devstack sudo[93574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ar80e36y Jun 04 06:31:09 devstack sudo[93574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:10 devstack sudo[93574]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9ce5e4c2-5f21-46b0-9b50-ed68cda35314 tempest-VolumesActionsTest-295207613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ar80e36y" returned: 0 in 0.693s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:31:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:31:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:31:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:31:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:31:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:31:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:11 devstack sudo[93579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:31:11 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9ce5e4c2-5f21-46b0-9b50-ed68cda35314 tempest-VolumesActionsTest-295207613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.988s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:31:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9ce5e4c2-5f21-46b0-9b50-ed68cda35314 tempest-VolumesActionsTest-295207613 None] Uploaded volume to glance image-id: 8961971d-6b2c-416e-808e-39aa12dbbe7c. {{(pid=86069) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1782}} Jun 04 06:31:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.638s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:31:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-977402118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24563fc-a785-4b42-af32-872643efe470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bdde5be5eff46e9b943f720e48197c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:30:58Z,use_quota=True,user_id='33c0a4d7c711403b820f5d41828a613c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:31:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] Creating volume b24563fc-a785-4b42-af32-872643efe470 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:31:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:31:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:31:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:31:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:31:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:31:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:31:11 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:31:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b24563fc-a785-4b42-af32-872643efe470 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:11 devstack sudo[93581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b24563fc-a785-4b42-af32-872643efe470 1073741824 Jun 04 06:31:11 devstack sudo[93581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:11 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-9ce5e4c2-5f21-46b0-9b50-ed68cda35314 tempest-VolumesActionsTest-295207613 None] Copy volume to image completed successfully. Jun 04 06:31:11 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.668s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:11 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:31:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager._thread_info {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:31:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread count: 28 {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 06:31:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread info: [<_MainThread(MainThread, started 131797370544256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 06:31:12 devstack sudo[93581]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b24563fc-a785-4b42-af32-872643efe470 1073741824" returned: 0 in 0.809s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b24563fc-a785-4b42-af32-872643efe470 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:12 devstack sudo[93587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b24563fc-a785-4b42-af32-872643efe470 Jun 04 06:31:12 devstack sudo[93587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:13 devstack sudo[93587]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b24563fc-a785-4b42-af32-872643efe470" returned: 0 in 0.693s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:13 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:31:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:31:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-857d9511-2634-484c-95f7-6228de29f58e tempest-GroupSnapshotsV319Test-28590518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.554s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:31:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (529232ea-747b-44d9-95f8-6b470caa2f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b24563fc-a785-4b42-af32-872643efe470', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:31:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f4f9964-babf-4203-bf7e-53317dd4f5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:31:13 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-857d9511-2634-484c-95f7-6228de29f58e tempest-GroupSnapshotsV319Test-28590518 None] Creating offline snapshot e30c3c11-043a-4928-b15b-ea4127bf31ba of volume 45b4c3be-7969-4ad9-a892-69adc40c0f4b {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:31:13 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] Volume volume-b24563fc-a785-4b42-af32-872643efe470 (b24563fc-a785-4b42-af32-872643efe470): created successfully Jun 04 06:31:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f4f9964-babf-4203-bf7e-53317dd4f5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:31:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] Flow 'volume_create_manager' (12dd42e3-2beb-4bbb-ac70-b38020bc656e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:31:13 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d44563f-bcee-48ac-a1dd-9ae73821f9cb]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:31:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-857d9511-2634-484c-95f7-6228de29f58e tempest-GroupSnapshotsV319Test-28590518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:13 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-26022c39-8540-4585-af58-3acab930ad53 tempest-AttachVolumeNegativeTest-499422654 None] Created volume successfully. Jun 04 06:31:13 devstack sudo[93590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b Jun 04 06:31:13 devstack sudo[93590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:13 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ea04968d-125c-4a1d-81b5-d3f370f9321a tempest-VolumesActionsTest-295207613 None] Acquiring lock "cinder-9392238c-6c87-483e-9078-1ac623357ce0-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:31:13 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ea04968d-125c-4a1d-81b5-d3f370f9321a tempest-VolumesActionsTest-295207613 None] Lock "cinder-9392238c-6c87-483e-9078-1ac623357ce0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:31:13 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ea04968d-125c-4a1d-81b5-d3f370f9321a tempest-VolumesActionsTest-295207613 None] Acquiring lock "cinder-quobyte-9392238c-6c87-483e-9078-1ac623357ce0" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:31:13 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ea04968d-125c-4a1d-81b5-d3f370f9321a tempest-VolumesActionsTest-295207613 None] Lock "cinder-quobyte-9392238c-6c87-483e-9078-1ac623357ce0" acquired by "delete_volume" :: waited 0.015s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:31:13 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf071c8-42a2-4085-9f52-43f7a516673f]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:31:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ea04968d-125c-4a1d-81b5-d3f370f9321a tempest-VolumesActionsTest-295207613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:13 devstack sudo[93592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0 Jun 04 06:31:13 devstack sudo[93592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:14 devstack sudo[93590]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-857d9511-2634-484c-95f7-6228de29f58e tempest-GroupSnapshotsV319Test-28590518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b" returned: 0 in 0.885s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-857d9511-2634-484c-95f7-6228de29f58e tempest-GroupSnapshotsV319Test-28590518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b.e30c3c11-043a-4928-b15b-ea4127bf31ba 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:14 devstack sudo[93597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b.e30c3c11-043a-4928-b15b-ea4127bf31ba 1G Jun 04 06:31:14 devstack sudo[93597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:14 devstack sudo[93592]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ea04968d-125c-4a1d-81b5-d3f370f9321a tempest-VolumesActionsTest-295207613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0" returned: 0 in 0.779s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ea04968d-125c-4a1d-81b5-d3f370f9321a tempest-VolumesActionsTest-295207613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:14 devstack sudo[93602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0 Jun 04 06:31:14 devstack sudo[93602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:14 devstack sudo[93602]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ea04968d-125c-4a1d-81b5-d3f370f9321a tempest-VolumesActionsTest-295207613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9392238c-6c87-483e-9078-1ac623357ce0" returned: 0 in 0.615s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:15 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ea04968d-125c-4a1d-81b5-d3f370f9321a tempest-VolumesActionsTest-295207613 None] Lock "cinder-quobyte-9392238c-6c87-483e-9078-1ac623357ce0" released by "delete_volume" :: held 1.456s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:31:15 devstack sudo[93597]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-857d9511-2634-484c-95f7-6228de29f58e tempest-GroupSnapshotsV319Test-28590518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b.e30c3c11-043a-4928-b15b-ea4127bf31ba 1G" returned: 0 in 0.946s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-857d9511-2634-484c-95f7-6228de29f58e tempest-GroupSnapshotsV319Test-28590518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b.e30c3c11-043a-4928-b15b-ea4127bf31ba {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:15 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-ea04968d-125c-4a1d-81b5-d3f370f9321a tempest-VolumesActionsTest-295207613 None] Created reservations ['c1597539-cf86-413f-8e9e-e59b8f845a27', '68827e12-e349-464c-83b3-1022bbb96c95', 'b04f3eb4-561d-498d-8aa6-9b801efd9d72', '1bfbf333-877a-4ece-9228-b96b3a2e9520'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:31:15 devstack sudo[93609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b.e30c3c11-043a-4928-b15b-ea4127bf31ba Jun 04 06:31:15 devstack sudo[93609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ea04968d-125c-4a1d-81b5-d3f370f9321a tempest-VolumesActionsTest-295207613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:31:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ea04968d-125c-4a1d-81b5-d3f370f9321a tempest-VolumesActionsTest-295207613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:31:15 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ea04968d-125c-4a1d-81b5-d3f370f9321a tempest-VolumesActionsTest-295207613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:31:15 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ea04968d-125c-4a1d-81b5-d3f370f9321a tempest-VolumesActionsTest-295207613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:31:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ea04968d-125c-4a1d-81b5-d3f370f9321a tempest-VolumesActionsTest-295207613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:31:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ea04968d-125c-4a1d-81b5-d3f370f9321a tempest-VolumesActionsTest-295207613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:15 devstack sudo[93611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:31:15 devstack sudo[93611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:15 devstack sudo[93609]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-857d9511-2634-484c-95f7-6228de29f58e tempest-GroupSnapshotsV319Test-28590518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b.e30c3c11-043a-4928-b15b-ea4127bf31ba" returned: 0 in 0.821s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:15 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-857d9511-2634-484c-95f7-6228de29f58e tempest-GroupSnapshotsV319Test-28590518 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b.e30c3c11-043a-4928-b15b-ea4127bf31ba is being set with open permissions: ugo+rw: NotImplementedError Jun 04 06:31:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-857d9511-2634-484c-95f7-6228de29f58e tempest-GroupSnapshotsV319Test-28590518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b.e30c3c11-043a-4928-b15b-ea4127bf31ba {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:15 devstack sudo[93617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b.e30c3c11-043a-4928-b15b-ea4127bf31ba Jun 04 06:31:15 devstack sudo[93617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:16 devstack sudo[93611]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ea04968d-125c-4a1d-81b5-d3f370f9321a tempest-VolumesActionsTest-295207613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.852s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:16 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-ea04968d-125c-4a1d-81b5-d3f370f9321a tempest-VolumesActionsTest-295207613 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:31:16 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-ea04968d-125c-4a1d-81b5-d3f370f9321a tempest-VolumesActionsTest-295207613 None] Deleted volume successfully. Jun 04 06:31:16 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ea04968d-125c-4a1d-81b5-d3f370f9321a tempest-VolumesActionsTest-295207613 None] Lock "cinder-9392238c-6c87-483e-9078-1ac623357ce0-delete_volume" released by "delete_volume" :: held 2.581s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:31:16 devstack sudo[93617]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-857d9511-2634-484c-95f7-6228de29f58e tempest-GroupSnapshotsV319Test-28590518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b.e30c3c11-043a-4928-b15b-ea4127bf31ba" returned: 0 in 0.813s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-857d9511-2634-484c-95f7-6228de29f58e tempest-GroupSnapshotsV319Test-28590518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:16 devstack sudo[93629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b.info Jun 04 06:31:16 devstack sudo[93629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-0c160003-5aa2-404f-82a4-7ad950d9a674 req-245365bc-8e8f-427f-9354-b7165438a1fe tempest-AttachVolumeNegativeTest-499422654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:31:17 devstack sudo[93629]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-857d9511-2634-484c-95f7-6228de29f58e tempest-GroupSnapshotsV319Test-28590518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b.info" returned: 0 in 0.651s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:17 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-857d9511-2634-484c-95f7-6228de29f58e tempest-GroupSnapshotsV319Test-28590518 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b.info is being set with open permissions: ugo+rw: NotImplementedError Jun 04 06:31:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-857d9511-2634-484c-95f7-6228de29f58e tempest-GroupSnapshotsV319Test-28590518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:17 devstack sudo[93632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b.info Jun 04 06:31:17 devstack sudo[93632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:17 devstack sudo[93632]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-857d9511-2634-484c-95f7-6228de29f58e tempest-GroupSnapshotsV319Test-28590518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b.info" returned: 0 in 0.576s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-857d9511-2634-484c-95f7-6228de29f58e tempest-GroupSnapshotsV319Test-28590518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.819s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:31:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-0c160003-5aa2-404f-82a4-7ad950d9a674 req-245365bc-8e8f-427f-9354-b7165438a1fe tempest-AttachVolumeNegativeTest-499422654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.135s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:31:18 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[beec019e-f662-47c2-bc5a-22a83c495183]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:31:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-0c160003-5aa2-404f-82a4-7ad950d9a674 req-245365bc-8e8f-427f-9354-b7165438a1fe tempest-AttachVolumeNegativeTest-499422654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b24563fc-a785-4b42-af32-872643efe470 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:18 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-857d9511-2634-484c-95f7-6228de29f58e tempest-GroupSnapshotsV319Test-28590518 None] group_snapshot 81e11dc7-0344-42e1-92e1-5336ae246879: created successfully Jun 04 06:31:18 devstack sudo[93647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b24563fc-a785-4b42-af32-872643efe470 Jun 04 06:31:18 devstack sudo[93647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:18 devstack sudo[93647]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-0c160003-5aa2-404f-82a4-7ad950d9a674 req-245365bc-8e8f-427f-9354-b7165438a1fe tempest-AttachVolumeNegativeTest-499422654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b24563fc-a785-4b42-af32-872643efe470" returned: 0 in 0.719s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-0c160003-5aa2-404f-82a4-7ad950d9a674 req-245365bc-8e8f-427f-9354-b7165438a1fe tempest-AttachVolumeNegativeTest-499422654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.750s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:31:18 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-0c160003-5aa2-404f-82a4-7ad950d9a674 req-245365bc-8e8f-427f-9354-b7165438a1fe tempest-AttachVolumeNegativeTest-499422654 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574', 'name': 'volume-b24563fc-a785-4b42-af32-872643efe470', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f801c07c-d04e-434c-9e95-6b38678e7860', 'enforce_multipath': True} {{(pid=86069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 06:31:18 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-0c160003-5aa2-404f-82a4-7ad950d9a674 req-245365bc-8e8f-427f-9354-b7165438a1fe tempest-AttachVolumeNegativeTest-499422654 None] attachment_update completed successfully. Jun 04 06:31:19 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-8823536f-61dd-4a86-b447-cbdb1f97d5ea tempest-GroupSnapshotsV319Test-28590518 None] group_snapshot 81e11dc7-0344-42e1-92e1-5336ae246879: deleting Jun 04 06:31:19 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8823536f-61dd-4a86-b447-cbdb1f97d5ea tempest-GroupSnapshotsV319Test-28590518 None] group_snapshot 81e11dc7-0344-42e1-92e1-5336ae246879: deleting {{(pid=86069) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Jun 04 06:31:19 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-8823536f-61dd-4a86-b447-cbdb1f97d5ea tempest-GroupSnapshotsV319Test-28590518 None] Acquiring lock "cinder-quobyte-45b4c3be-7969-4ad9-a892-69adc40c0f4b" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:31:19 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-8823536f-61dd-4a86-b447-cbdb1f97d5ea tempest-GroupSnapshotsV319Test-28590518 None] Lock "cinder-quobyte-45b4c3be-7969-4ad9-a892-69adc40c0f4b" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:31:19 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-8823536f-61dd-4a86-b447-cbdb1f97d5ea tempest-GroupSnapshotsV319Test-28590518 None] Acquiring lock "cinder-quobyte-e30c3c11-043a-4928-b15b-ea4127bf31ba" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:31:19 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-8823536f-61dd-4a86-b447-cbdb1f97d5ea tempest-GroupSnapshotsV319Test-28590518 None] Lock "cinder-quobyte-e30c3c11-043a-4928-b15b-ea4127bf31ba" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:31:19 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-8823536f-61dd-4a86-b447-cbdb1f97d5ea tempest-GroupSnapshotsV319Test-28590518 None] Deleting offline snapshot e30c3c11-043a-4928-b15b-ea4127bf31ba of volume 45b4c3be-7969-4ad9-a892-69adc40c0f4b {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:31:19 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-8823536f-61dd-4a86-b447-cbdb1f97d5ea tempest-GroupSnapshotsV319Test-28590518 None] snapshot_file for this snap is: volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b.e30c3c11-043a-4928-b15b-ea4127bf31ba {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:31:19 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5aba118-5ac8-4fde-9301-4da4a7ac563d]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:31:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8823536f-61dd-4a86-b447-cbdb1f97d5ea tempest-GroupSnapshotsV319Test-28590518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b.e30c3c11-043a-4928-b15b-ea4127bf31ba {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:19 devstack sudo[93676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b.e30c3c11-043a-4928-b15b-ea4127bf31ba Jun 04 06:31:19 devstack sudo[93676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:20 devstack sudo[93676]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8823536f-61dd-4a86-b447-cbdb1f97d5ea tempest-GroupSnapshotsV319Test-28590518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b.e30c3c11-043a-4928-b15b-ea4127bf31ba" returned: 0 in 0.808s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:20 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-8823536f-61dd-4a86-b447-cbdb1f97d5ea tempest-GroupSnapshotsV319Test-28590518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:31:20 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[2125608c-fd84-4a0f-bd6a-e97cc16878ca]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:31:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8823536f-61dd-4a86-b447-cbdb1f97d5ea tempest-GroupSnapshotsV319Test-28590518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:20 devstack sudo[94044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b Jun 04 06:31:20 devstack sudo[94044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:21 devstack sudo[94044]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8823536f-61dd-4a86-b447-cbdb1f97d5ea tempest-GroupSnapshotsV319Test-28590518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b" returned: 0 in 0.857s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8823536f-61dd-4a86-b447-cbdb1f97d5ea tempest-GroupSnapshotsV319Test-28590518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b.e30c3c11-043a-4928-b15b-ea4127bf31ba {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:21 devstack sudo[94049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b.e30c3c11-043a-4928-b15b-ea4127bf31ba Jun 04 06:31:21 devstack sudo[94049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:22 devstack sudo[94049]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8823536f-61dd-4a86-b447-cbdb1f97d5ea tempest-GroupSnapshotsV319Test-28590518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b.e30c3c11-043a-4928-b15b-ea4127bf31ba" returned: 0 in 0.742s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8823536f-61dd-4a86-b447-cbdb1f97d5ea tempest-GroupSnapshotsV319Test-28590518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b.e30c3c11-043a-4928-b15b-ea4127bf31ba {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:22 devstack sudo[94055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b.e30c3c11-043a-4928-b15b-ea4127bf31ba Jun 04 06:31:22 devstack sudo[94055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:22 devstack sudo[94055]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8823536f-61dd-4a86-b447-cbdb1f97d5ea tempest-GroupSnapshotsV319Test-28590518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b.e30c3c11-043a-4928-b15b-ea4127bf31ba" returned: 0 in 0.639s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:22 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-8823536f-61dd-4a86-b447-cbdb1f97d5ea tempest-GroupSnapshotsV319Test-28590518 None] Lock "cinder-quobyte-e30c3c11-043a-4928-b15b-ea4127bf31ba" released by "_delete_snapshot" :: held 3.209s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:31:22 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-8823536f-61dd-4a86-b447-cbdb1f97d5ea tempest-GroupSnapshotsV319Test-28590518 None] Lock "cinder-quobyte-45b4c3be-7969-4ad9-a892-69adc40c0f4b" released by "delete_snapshot" :: held 3.242s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:31:22 devstack cinder-volume[86069]: WARNING cinder.quota [None req-8823536f-61dd-4a86-b447-cbdb1f97d5ea tempest-GroupSnapshotsV319Test-28590518 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1469941572 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1469941572, it is now deprecated. Please use the default quota class for default quota. Jun 04 06:31:22 devstack cinder-volume[86069]: WARNING cinder.quota [None req-8823536f-61dd-4a86-b447-cbdb1f97d5ea tempest-GroupSnapshotsV319Test-28590518 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1469941572 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1469941572, it is now deprecated. Please use the default quota class for default quota. Jun 04 06:31:22 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-8823536f-61dd-4a86-b447-cbdb1f97d5ea tempest-GroupSnapshotsV319Test-28590518 None] Created reservations ['863facd0-c802-4420-a95b-ad918cb29ac6', '7d016c5c-4d5b-46e1-b25d-c6d324a8bab3', '66f0be43-0f8c-4f24-b805-f03d978efc13', '63769389-5826-4e2e-8264-7460d0f68755'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:31:22 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-8823536f-61dd-4a86-b447-cbdb1f97d5ea tempest-GroupSnapshotsV319Test-28590518 None] group_snapshot 81e11dc7-0344-42e1-92e1-5336ae246879: deleted successfully Jun 04 06:31:24 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-92153266-d125-44ec-bfeb-1cf5d1786391 tempest-GroupSnapshotsV319Test-28590518 None] Acquiring lock "cinder-quobyte-45b4c3be-7969-4ad9-a892-69adc40c0f4b" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:31:24 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-92153266-d125-44ec-bfeb-1cf5d1786391 tempest-GroupSnapshotsV319Test-28590518 None] Lock "cinder-quobyte-45b4c3be-7969-4ad9-a892-69adc40c0f4b" acquired by "delete_volume" :: waited 0.028s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:31:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-9700d856-8462-415a-b537-c18ad55f0c5d req-54adc9a4-3ea5-477e-b3c3-eed9f46b189e tempest-ServerActionsTestOtherA-1981488141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:31:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-9700d856-8462-415a-b537-c18ad55f0c5d req-54adc9a4-3ea5-477e-b3c3-eed9f46b189e tempest-ServerActionsTestOtherA-1981488141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:31:24 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79fea4d-c2cb-4671-8694-c3fd51c924f4]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:31:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-92153266-d125-44ec-bfeb-1cf5d1786391 tempest-GroupSnapshotsV319Test-28590518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:24 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c39c69-bb5b-495a-8187-9a1c889db0b4]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:31:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-9700d856-8462-415a-b537-c18ad55f0c5d req-54adc9a4-3ea5-477e-b3c3-eed9f46b189e tempest-ServerActionsTestOtherA-1981488141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0b48fe95-fd69-4e4b-8baa-18f7de8c1b11 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:24 devstack sudo[94068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b Jun 04 06:31:24 devstack sudo[94068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:24 devstack sudo[94069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0b48fe95-fd69-4e4b-8baa-18f7de8c1b11 Jun 04 06:31:24 devstack sudo[94069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:24 devstack sudo[94068]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-92153266-d125-44ec-bfeb-1cf5d1786391 tempest-GroupSnapshotsV319Test-28590518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b" returned: 0 in 0.837s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-92153266-d125-44ec-bfeb-1cf5d1786391 tempest-GroupSnapshotsV319Test-28590518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:25 devstack sudo[94114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b Jun 04 06:31:25 devstack sudo[94114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:25 devstack sudo[94069]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-9700d856-8462-415a-b537-c18ad55f0c5d req-54adc9a4-3ea5-477e-b3c3-eed9f46b189e tempest-ServerActionsTestOtherA-1981488141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0b48fe95-fd69-4e4b-8baa-18f7de8c1b11" returned: 0 in 0.961s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-9700d856-8462-415a-b537-c18ad55f0c5d req-54adc9a4-3ea5-477e-b3c3-eed9f46b189e tempest-ServerActionsTestOtherA-1981488141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.990s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-9700d856-8462-415a-b537-c18ad55f0c5d req-54adc9a4-3ea5-477e-b3c3-eed9f46b189e tempest-ServerActionsTestOtherA-1981488141 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574', 'name': 'volume-0b48fe95-fd69-4e4b-8baa-18f7de8c1b11', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6f7e12da-933d-4b28-a10f-dd017f2f51a1', 'enforce_multipath': True} {{(pid=86069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 06:31:25 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-9700d856-8462-415a-b537-c18ad55f0c5d req-54adc9a4-3ea5-477e-b3c3-eed9f46b189e tempest-ServerActionsTestOtherA-1981488141 None] attachment_update completed successfully. Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Flow 'volume_create_manager' (f29918d9-848c-4289-90a5-6f3225281568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec10812c-6dd9-43fa-9513-f77b2166898d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:31:25 devstack sudo[94114]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec10812c-6dd9-43fa-9513-f77b2166898d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1352368179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2193e57a-54e4-4006-94d7-b4a612f8470c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19adf981472b48c18160ca8be66c88a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:31:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:31:26Z,use_quota=True,user_id='5b81ab2e004b485299df88ca0cc1819f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1c5d4c0-99a6-4bbe-912b-beb168553647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1c5d4c0-99a6-4bbe-912b-beb168553647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (790fe04f-1480-40cd-8c2e-11d8e7a141c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (790fe04f-1480-40cd-8c2e-11d8e7a141c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2193e57a-54e4-4006-94d7-b4a612f8470c', 'volume_name': 'volume-2193e57a-54e4-4006-94d7-b4a612f8470c', 'volume_size': 2}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (074a8d12-dac5-46f6-b320-8341ffccafe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (074a8d12-dac5-46f6-b320-8341ffccafe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4237d4-8835-42a4-82e3-489dc821dcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:31:25 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Volume 2193e57a-54e4-4006-94d7-b4a612f8470c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2193e57a-54e4-4006-94d7-b4a612f8470c', 'volume_size': 2} Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1352368179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2193e57a-54e4-4006-94d7-b4a612f8470c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19adf981472b48c18160ca8be66c88a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:31:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:31:26Z,use_quota=True,user_id='5b81ab2e004b485299df88ca0cc1819f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Creating volume 2193e57a-54e4-4006-94d7-b4a612f8470c {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:31:25 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c 2147483648 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-92153266-d125-44ec-bfeb-1cf5d1786391 tempest-GroupSnapshotsV319Test-28590518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-45b4c3be-7969-4ad9-a892-69adc40c0f4b" returned: 0 in 0.718s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:25 devstack sudo[94117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c 2147483648 Jun 04 06:31:25 devstack sudo[94117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-92153266-d125-44ec-bfeb-1cf5d1786391 tempest-GroupSnapshotsV319Test-28590518 None] Lock "cinder-quobyte-45b4c3be-7969-4ad9-a892-69adc40c0f4b" released by "delete_volume" :: held 1.647s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-92153266-d125-44ec-bfeb-1cf5d1786391 tempest-GroupSnapshotsV319Test-28590518 None] Created reservations ['1057276c-4849-465a-80d9-dd3270fa60ec'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:31:25 devstack cinder-volume[86069]: WARNING cinder.quota [None req-92153266-d125-44ec-bfeb-1cf5d1786391 tempest-GroupSnapshotsV319Test-28590518 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1469941572 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1469941572, it is now deprecated. Please use the default quota class for default quota. Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-92153266-d125-44ec-bfeb-1cf5d1786391 tempest-GroupSnapshotsV319Test-28590518 None] Created reservations ['73761ad1-d4a3-4e8a-ac76-ce71895ab829', 'd3267f03-b514-404a-8b0c-ed99c929a52b', '5b7f189a-85f6-45b3-a9b4-dd8adbea708d', 'ecf519ea-e91c-4c59-9f20-7d7c1cf2b843'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-92153266-d125-44ec-bfeb-1cf5d1786391 tempest-GroupSnapshotsV319Test-28590518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-92153266-d125-44ec-bfeb-1cf5d1786391 tempest-GroupSnapshotsV319Test-28590518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-92153266-d125-44ec-bfeb-1cf5d1786391 tempest-GroupSnapshotsV319Test-28590518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-92153266-d125-44ec-bfeb-1cf5d1786391 tempest-GroupSnapshotsV319Test-28590518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-92153266-d125-44ec-bfeb-1cf5d1786391 tempest-GroupSnapshotsV319Test-28590518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:31:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-92153266-d125-44ec-bfeb-1cf5d1786391 tempest-GroupSnapshotsV319Test-28590518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:25 devstack sudo[94119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:31:25 devstack sudo[94119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:26 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-31450410-11eb-48b7-a0ed-977a0bebbc38 req-40d7f648-99f5-450b-a2f0-269e30125457 tempest-AttachVolumeNegativeTest-499422654 None] Terminate volume connection completed successfully. Jun 04 06:31:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-31450410-11eb-48b7-a0ed-977a0bebbc38 req-40d7f648-99f5-450b-a2f0-269e30125457 tempest-AttachVolumeNegativeTest-499422654 None] Deleting attachment f801c07c-d04e-434c-9e95-6b38678e7860. {{(pid=86069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 06:31:26 devstack sudo[94119]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-92153266-d125-44ec-bfeb-1cf5d1786391 tempest-GroupSnapshotsV319Test-28590518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.706s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:26 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-92153266-d125-44ec-bfeb-1cf5d1786391 tempest-GroupSnapshotsV319Test-28590518 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:31:26 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-92153266-d125-44ec-bfeb-1cf5d1786391 tempest-GroupSnapshotsV319Test-28590518 None] Delete group completed successfully. Jun 04 06:31:26 devstack sudo[94117]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c 2147483648" returned: 0 in 0.970s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:26 devstack sudo[94131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c Jun 04 06:31:26 devstack sudo[94131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:27 devstack sudo[94131]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c" returned: 0 in 0.638s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:31:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:31:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4237d4-8835-42a4-82e3-489dc821dcb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2193e57a-54e4-4006-94d7-b4a612f8470c', 'volume_size': 2}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:31:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ad62072-9788-4648-b17f-58a726d7d46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:31:27 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Volume volume-2193e57a-54e4-4006-94d7-b4a612f8470c (2193e57a-54e4-4006-94d7-b4a612f8470c): created successfully Jun 04 06:31:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ad62072-9788-4648-b17f-58a726d7d46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:31:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Flow 'volume_create_manager' (f29918d9-848c-4289-90a5-6f3225281568) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:31:27 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-c19aec03-0901-4a6e-b2cd-ba900429450d tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Created volume successfully. Jun 04 06:31:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ea208e38-7db6-434b-9b94-da255b856267 tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:31:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ea208e38-7db6-434b-9b94-da255b856267 tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:31:28 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-ea208e38-7db6-434b-9b94-da255b856267 tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Creating offline snapshot b979debf-b1e8-453d-a4bb-4670e4617a29 of volume 2193e57a-54e4-4006-94d7-b4a612f8470c {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:31:28 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b58364-9d69-49d0-9901-c9b3a955da6a]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:31:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ea208e38-7db6-434b-9b94-da255b856267 tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:28 devstack sudo[94134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c Jun 04 06:31:28 devstack sudo[94134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:28 devstack sudo[94134]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ea208e38-7db6-434b-9b94-da255b856267 tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c" returned: 0 in 0.824s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ea208e38-7db6-434b-9b94-da255b856267 tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c.b979debf-b1e8-453d-a4bb-4670e4617a29 2G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:28 devstack sudo[94139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c.b979debf-b1e8-453d-a4bb-4670e4617a29 2G Jun 04 06:31:28 devstack sudo[94139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:29 devstack sudo[94139]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ea208e38-7db6-434b-9b94-da255b856267 tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c.b979debf-b1e8-453d-a4bb-4670e4617a29 2G" returned: 0 in 1.066s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ea208e38-7db6-434b-9b94-da255b856267 tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2193e57a-54e4-4006-94d7-b4a612f8470c -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c.b979debf-b1e8-453d-a4bb-4670e4617a29 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:29 devstack sudo[94180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2193e57a-54e4-4006-94d7-b4a612f8470c -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c.b979debf-b1e8-453d-a4bb-4670e4617a29 Jun 04 06:31:29 devstack sudo[94180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:30 devstack sudo[94180]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ea208e38-7db6-434b-9b94-da255b856267 tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2193e57a-54e4-4006-94d7-b4a612f8470c -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c.b979debf-b1e8-453d-a4bb-4670e4617a29" returned: 0 in 0.933s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:30 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-ea208e38-7db6-434b-9b94-da255b856267 tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c.b979debf-b1e8-453d-a4bb-4670e4617a29 is being set with open permissions: ugo+rw Jun 04 06:31:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ea208e38-7db6-434b-9b94-da255b856267 tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c.b979debf-b1e8-453d-a4bb-4670e4617a29 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:30 devstack sudo[94186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c.b979debf-b1e8-453d-a4bb-4670e4617a29 Jun 04 06:31:30 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:31 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ea208e38-7db6-434b-9b94-da255b856267 tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c.b979debf-b1e8-453d-a4bb-4670e4617a29" returned: 0 in 0.658s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ea208e38-7db6-434b-9b94-da255b856267 tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:31 devstack sudo[94189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c.info Jun 04 06:31:31 devstack sudo[94189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:32 devstack sudo[94189]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ea208e38-7db6-434b-9b94-da255b856267 tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c.info" returned: 0 in 0.845s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:32 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-ea208e38-7db6-434b-9b94-da255b856267 tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c.info is being set with open permissions: ugo+rw Jun 04 06:31:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ea208e38-7db6-434b-9b94-da255b856267 tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:32 devstack sudo[94207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c.info Jun 04 06:31:32 devstack sudo[94207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:32 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-f757c916-1626-4bf1-bbde-f1d56c5eb263 tempest-GroupsTest-1044337045 None] Group tempest-Group1-1991669866: creating Jun 04 06:31:32 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-f757c916-1626-4bf1-bbde-f1d56c5eb263 tempest-GroupsTest-1044337045 None] Group tempest-Group1-1991669866: created successfully Jun 04 06:31:32 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-f757c916-1626-4bf1-bbde-f1d56c5eb263 tempest-GroupsTest-1044337045 None] Create group completed successfully. Jun 04 06:31:33 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-5cabe385-c654-4d95-a7c5-704f4fee226f req-b1f44a29-10de-4cb9-849b-41fffa556db1 tempest-ServerActionsTestOtherA-1981488141 None] Terminate volume connection completed successfully. Jun 04 06:31:33 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-5cabe385-c654-4d95-a7c5-704f4fee226f req-b1f44a29-10de-4cb9-849b-41fffa556db1 tempest-ServerActionsTestOtherA-1981488141 None] Deleting attachment 6f7e12da-933d-4b28-a10f-dd017f2f51a1. {{(pid=86069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 06:31:33 devstack sudo[94207]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ea208e38-7db6-434b-9b94-da255b856267 tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c.info" returned: 0 in 0.930s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ea208e38-7db6-434b-9b94-da255b856267 tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.376s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:31:33 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-ea208e38-7db6-434b-9b94-da255b856267 tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Create snapshot completed successfully Jun 04 06:31:33 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-01604d21-f91e-4942-b88e-59d91ec2d643 tempest-GroupsTest-1044337045 None] Group tempest-Group2-167413850: creating Jun 04 06:31:33 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-01604d21-f91e-4942-b88e-59d91ec2d643 tempest-GroupsTest-1044337045 None] Group tempest-Group2-167413850: created successfully Jun 04 06:31:33 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-01604d21-f91e-4942-b88e-59d91ec2d643 tempest-GroupsTest-1044337045 None] Create group completed successfully. Jun 04 06:31:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-76c7031b-422f-4cc5-82fd-579287e5984f tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Acquiring lock "cinder-b979debf-b1e8-453d-a4bb-4670e4617a29-delete_snapshot" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:31:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-76c7031b-422f-4cc5-82fd-579287e5984f tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Lock "cinder-b979debf-b1e8-453d-a4bb-4670e4617a29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:31:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-76c7031b-422f-4cc5-82fd-579287e5984f tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Acquiring lock "cinder-quobyte-2193e57a-54e4-4006-94d7-b4a612f8470c" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:31:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-76c7031b-422f-4cc5-82fd-579287e5984f tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Lock "cinder-quobyte-2193e57a-54e4-4006-94d7-b4a612f8470c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:31:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-76c7031b-422f-4cc5-82fd-579287e5984f tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Acquiring lock "cinder-quobyte-b979debf-b1e8-453d-a4bb-4670e4617a29" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:31:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-76c7031b-422f-4cc5-82fd-579287e5984f tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Lock "cinder-quobyte-b979debf-b1e8-453d-a4bb-4670e4617a29" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:31:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-76c7031b-422f-4cc5-82fd-579287e5984f tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Deleting offline snapshot b979debf-b1e8-453d-a4bb-4670e4617a29 of volume 2193e57a-54e4-4006-94d7-b4a612f8470c {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:31:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-76c7031b-422f-4cc5-82fd-579287e5984f tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] snapshot_file for this snap is: volume-2193e57a-54e4-4006-94d7-b4a612f8470c.b979debf-b1e8-453d-a4bb-4670e4617a29 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:31:34 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1517493-9841-453f-8a04-aae7456603c9]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:31:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-76c7031b-422f-4cc5-82fd-579287e5984f tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c.b979debf-b1e8-453d-a4bb-4670e4617a29 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:34 devstack sudo[94284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c.b979debf-b1e8-453d-a4bb-4670e4617a29 Jun 04 06:31:34 devstack sudo[94284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:35 devstack sudo[94284]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-76c7031b-422f-4cc5-82fd-579287e5984f tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c.b979debf-b1e8-453d-a4bb-4670e4617a29" returned: 0 in 0.735s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-76c7031b-422f-4cc5-82fd-579287e5984f tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2193e57a-54e4-4006-94d7-b4a612f8470c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:31:35 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b446792-1033-4c83-a86f-9177ee255a6d]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:31:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-76c7031b-422f-4cc5-82fd-579287e5984f tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:35 devstack sudo[94289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c Jun 04 06:31:35 devstack sudo[94289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:35 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:31:35 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] Flow 'volume_create_manager' (1f5a2d7d-6935-45fb-bff5-97ab61ce9364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:31:35 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b96dcf-51bf-4ed0-a404-3504566a17cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:31:35 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b96dcf-51bf-4ed0-a404-3504566a17cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1724507045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0fc51b65-5500-446f-b863-abd365134509,host='devstack@QuobyteHD#QuobyteHD',id=ec567dae-919c-4cb1-bf94-980dee652139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4e535c8223484189316599e1e6c003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:31:35Z,use_quota=True,user_id='d7a6410264f4448cb2ffca96a282bf49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e6c922e-ee80-4290-b401-bd583505565c),volume_type_id=9e6c922e-ee80-4290-b401-bd583505565c)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:31:35 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f5f7d4b-9a5f-4ec5-a3af-2d7b5f3d9a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:31:35 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f5f7d4b-9a5f-4ec5-a3af-2d7b5f3d9a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:31:35 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba2f9225-742e-479a-808b-4a1265955383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:31:35 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba2f9225-742e-479a-808b-4a1265955383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec567dae-919c-4cb1-bf94-980dee652139', 'volume_name': 'volume-ec567dae-919c-4cb1-bf94-980dee652139', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:31:35 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3071539-5a26-4a11-96ff-7c72ba7ea017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:31:35 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3071539-5a26-4a11-96ff-7c72ba7ea017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:31:35 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a34493d5-1c2a-490f-b2c7-76f06631bb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:31:35 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] Volume ec567dae-919c-4cb1-bf94-980dee652139: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec567dae-919c-4cb1-bf94-980dee652139', 'volume_size': 1} Jun 04 06:31:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:31:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:31:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0fc51b65-5500-446f-b863-abd365134509,created_at=2026-06-04T04:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1724507045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0fc51b65-5500-446f-b863-abd365134509,host='devstack@QuobyteHD#QuobyteHD',id=ec567dae-919c-4cb1-bf94-980dee652139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4e535c8223484189316599e1e6c003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:31:35Z,use_quota=True,user_id='d7a6410264f4448cb2ffca96a282bf49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e6c922e-ee80-4290-b401-bd583505565c),volume_type_id=9e6c922e-ee80-4290-b401-bd583505565c)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:31:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] Creating volume ec567dae-919c-4cb1-bf94-980dee652139 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:31:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:31:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:31:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:31:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:31:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:31:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:31:35 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:31:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec567dae-919c-4cb1-bf94-980dee652139 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:35 devstack sudo[94299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec567dae-919c-4cb1-bf94-980dee652139 1073741824 Jun 04 06:31:35 devstack sudo[94299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-5cabe385-c654-4d95-a7c5-704f4fee226f req-4e0f911e-8209-42ae-b6bf-402220d8cd80 tempest-ServerActionsTestOtherA-1981488141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:31:36 devstack sudo[94289]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-76c7031b-422f-4cc5-82fd-579287e5984f tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c" returned: 0 in 0.845s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-76c7031b-422f-4cc5-82fd-579287e5984f tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c.b979debf-b1e8-453d-a4bb-4670e4617a29 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:36 devstack sudo[94305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c.b979debf-b1e8-453d-a4bb-4670e4617a29 Jun 04 06:31:36 devstack sudo[94305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:36 devstack sudo[94299]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec567dae-919c-4cb1-bf94-980dee652139 1073741824" returned: 0 in 0.801s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec567dae-919c-4cb1-bf94-980dee652139 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:36 devstack sudo[94310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec567dae-919c-4cb1-bf94-980dee652139 Jun 04 06:31:36 devstack sudo[94310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:36 devstack sudo[94305]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-76c7031b-422f-4cc5-82fd-579287e5984f tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c.b979debf-b1e8-453d-a4bb-4670e4617a29" returned: 0 in 0.773s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-76c7031b-422f-4cc5-82fd-579287e5984f tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c.b979debf-b1e8-453d-a4bb-4670e4617a29 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:36 devstack sudo[94315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c.b979debf-b1e8-453d-a4bb-4670e4617a29 Jun 04 06:31:36 devstack sudo[94315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:37 devstack sudo[94310]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec567dae-919c-4cb1-bf94-980dee652139" returned: 0 in 0.649s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:37 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:31:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:31:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-5cabe385-c654-4d95-a7c5-704f4fee226f req-4e0f911e-8209-42ae-b6bf-402220d8cd80 tempest-ServerActionsTestOtherA-1981488141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.462s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:31:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a34493d5-1c2a-490f-b2c7-76f06631bb41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec567dae-919c-4cb1-bf94-980dee652139', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:31:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52693e8e-1591-49ed-8dab-c1299b0d22a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:31:37 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a3d825-027d-45ae-9950-9bc1ada538f1]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:31:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-5cabe385-c654-4d95-a7c5-704f4fee226f req-4e0f911e-8209-42ae-b6bf-402220d8cd80 tempest-ServerActionsTestOtherA-1981488141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0b48fe95-fd69-4e4b-8baa-18f7de8c1b11 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:37 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] Volume volume-ec567dae-919c-4cb1-bf94-980dee652139 (ec567dae-919c-4cb1-bf94-980dee652139): created successfully Jun 04 06:31:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52693e8e-1591-49ed-8dab-c1299b0d22a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:31:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] Flow 'volume_create_manager' (1f5a2d7d-6935-45fb-bff5-97ab61ce9364) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:31:37 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-646f2ca5-4d0f-49c8-9c26-ca379569a164 tempest-GroupsTest-1044337045 None] Created volume successfully. Jun 04 06:31:37 devstack sudo[94318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0b48fe95-fd69-4e4b-8baa-18f7de8c1b11 Jun 04 06:31:37 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:37 devstack sudo[94315]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-76c7031b-422f-4cc5-82fd-579287e5984f tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c.b979debf-b1e8-453d-a4bb-4670e4617a29" returned: 0 in 0.675s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:37 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-76c7031b-422f-4cc5-82fd-579287e5984f tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Lock "cinder-quobyte-b979debf-b1e8-453d-a4bb-4670e4617a29" released by "_delete_snapshot" :: held 3.160s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:31:37 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-76c7031b-422f-4cc5-82fd-579287e5984f tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Lock "cinder-quobyte-2193e57a-54e4-4006-94d7-b4a612f8470c" released by "delete_snapshot" :: held 3.186s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:31:37 devstack cinder-volume[86069]: WARNING cinder.quota [None req-76c7031b-422f-4cc5-82fd-579287e5984f tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 04 06:31:37 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-76c7031b-422f-4cc5-82fd-579287e5984f tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Created reservations ['842c3e41-1c1e-46e3-bbac-606e5e9f8dd3', '7b68a785-8df8-4375-8541-b8212ec76c36', '26c47f82-3763-46bc-adf6-b4718e7e0537', 'b7960917-0c14-42f9-8e62-86979e9621c1'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:31:37 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-76c7031b-422f-4cc5-82fd-579287e5984f tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Delete snapshot completed successfully. Jun 04 06:31:37 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-76c7031b-422f-4cc5-82fd-579287e5984f tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Lock "cinder-b979debf-b1e8-453d-a4bb-4670e4617a29-delete_snapshot" released by "delete_snapshot" :: held 3.350s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:31:37 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0ef37754-b65b-4d9f-bdf2-fcf2ccd817a8 tempest-AttachVolumeNegativeTest-499422654 None] Acquiring lock "cinder-b24563fc-a785-4b42-af32-872643efe470-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:31:37 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0ef37754-b65b-4d9f-bdf2-fcf2ccd817a8 tempest-AttachVolumeNegativeTest-499422654 None] Lock "cinder-b24563fc-a785-4b42-af32-872643efe470-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:31:37 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0ef37754-b65b-4d9f-bdf2-fcf2ccd817a8 tempest-AttachVolumeNegativeTest-499422654 None] Acquiring lock "cinder-quobyte-b24563fc-a785-4b42-af32-872643efe470" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:31:37 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0ef37754-b65b-4d9f-bdf2-fcf2ccd817a8 tempest-AttachVolumeNegativeTest-499422654 None] Lock "cinder-quobyte-b24563fc-a785-4b42-af32-872643efe470" acquired by "delete_volume" :: waited 0.017s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:31:37 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba180e3-5edd-4191-9511-1a31831e0bd7]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:31:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0ef37754-b65b-4d9f-bdf2-fcf2ccd817a8 tempest-AttachVolumeNegativeTest-499422654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b24563fc-a785-4b42-af32-872643efe470 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:38 devstack sudo[94321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b24563fc-a785-4b42-af32-872643efe470 Jun 04 06:31:38 devstack sudo[94321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:38 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-5cabe385-c654-4d95-a7c5-704f4fee226f req-4e0f911e-8209-42ae-b6bf-402220d8cd80 tempest-ServerActionsTestOtherA-1981488141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0b48fe95-fd69-4e4b-8baa-18f7de8c1b11" returned: 0 in 0.961s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-5cabe385-c654-4d95-a7c5-704f4fee226f req-4e0f911e-8209-42ae-b6bf-402220d8cd80 tempest-ServerActionsTestOtherA-1981488141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.993s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:31:38 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-5cabe385-c654-4d95-a7c5-704f4fee226f req-4e0f911e-8209-42ae-b6bf-402220d8cd80 tempest-ServerActionsTestOtherA-1981488141 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574', 'name': 'volume-0b48fe95-fd69-4e4b-8baa-18f7de8c1b11', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bff19bb4-7f36-436e-8ba0-6d30ce5dd8b7', 'enforce_multipath': True} {{(pid=86069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 06:31:38 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-5cabe385-c654-4d95-a7c5-704f4fee226f req-4e0f911e-8209-42ae-b6bf-402220d8cd80 tempest-ServerActionsTestOtherA-1981488141 None] attachment_update completed successfully. Jun 04 06:31:38 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-94b4a27d-a710-4702-9b1a-d422142af958 tempest-GroupsTest-1044337045 None] Acquiring lock "cinder-quobyte-ec567dae-919c-4cb1-bf94-980dee652139" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:31:38 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-94b4a27d-a710-4702-9b1a-d422142af958 tempest-GroupsTest-1044337045 None] Lock "cinder-quobyte-ec567dae-919c-4cb1-bf94-980dee652139" acquired by "delete_volume" :: waited 0.021s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:31:38 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[2165c8e1-2197-4b16-acbd-349bd40a8c63]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:31:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-94b4a27d-a710-4702-9b1a-d422142af958 tempest-GroupsTest-1044337045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec567dae-919c-4cb1-bf94-980dee652139 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:38 devstack sudo[94326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec567dae-919c-4cb1-bf94-980dee652139 Jun 04 06:31:38 devstack sudo[94326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:38 devstack sudo[94321]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0ef37754-b65b-4d9f-bdf2-fcf2ccd817a8 tempest-AttachVolumeNegativeTest-499422654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b24563fc-a785-4b42-af32-872643efe470" returned: 0 in 0.775s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0ef37754-b65b-4d9f-bdf2-fcf2ccd817a8 tempest-AttachVolumeNegativeTest-499422654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b24563fc-a785-4b42-af32-872643efe470 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:38 devstack sudo[94331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b24563fc-a785-4b42-af32-872643efe470 Jun 04 06:31:38 devstack sudo[94331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:38 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-fb2c10b3-1cbc-4ad4-9882-b1b487c0c52b tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Acquiring lock "cinder-2193e57a-54e4-4006-94d7-b4a612f8470c-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:31:38 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-fb2c10b3-1cbc-4ad4-9882-b1b487c0c52b tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Lock "cinder-2193e57a-54e4-4006-94d7-b4a612f8470c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:31:38 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-fb2c10b3-1cbc-4ad4-9882-b1b487c0c52b tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Acquiring lock "cinder-quobyte-2193e57a-54e4-4006-94d7-b4a612f8470c" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:31:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-fb2c10b3-1cbc-4ad4-9882-b1b487c0c52b tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Lock "cinder-quobyte-2193e57a-54e4-4006-94d7-b4a612f8470c" acquired by "delete_volume" :: waited 0.025s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:31:39 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcf5f8c-2663-4ae6-bbe5-bbe0c039a319]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:31:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fb2c10b3-1cbc-4ad4-9882-b1b487c0c52b tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:39 devstack sudo[94335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c Jun 04 06:31:39 devstack sudo[94335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:39 devstack sudo[94326]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-94b4a27d-a710-4702-9b1a-d422142af958 tempest-GroupsTest-1044337045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec567dae-919c-4cb1-bf94-980dee652139" returned: 0 in 0.755s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-94b4a27d-a710-4702-9b1a-d422142af958 tempest-GroupsTest-1044337045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec567dae-919c-4cb1-bf94-980dee652139 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:39 devstack sudo[94338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec567dae-919c-4cb1-bf94-980dee652139 Jun 04 06:31:39 devstack sudo[94338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:39 devstack sudo[94331]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0ef37754-b65b-4d9f-bdf2-fcf2ccd817a8 tempest-AttachVolumeNegativeTest-499422654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b24563fc-a785-4b42-af32-872643efe470" returned: 0 in 0.655s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0ef37754-b65b-4d9f-bdf2-fcf2ccd817a8 tempest-AttachVolumeNegativeTest-499422654 None] Lock "cinder-quobyte-b24563fc-a785-4b42-af32-872643efe470" released by "delete_volume" :: held 1.480s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:31:39 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-0ef37754-b65b-4d9f-bdf2-fcf2ccd817a8 tempest-AttachVolumeNegativeTest-499422654 None] Created reservations ['47518be4-2630-4602-b777-80696c0a7669', 'fe0d0463-4bc3-45ed-8293-a8ea377aa7be', '8fa764bf-26b7-470a-a9d7-5fb329ca6868', '35a2e789-afbd-4aef-b0f6-4e8432e256da'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:31:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0ef37754-b65b-4d9f-bdf2-fcf2ccd817a8 tempest-AttachVolumeNegativeTest-499422654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:31:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0ef37754-b65b-4d9f-bdf2-fcf2ccd817a8 tempest-AttachVolumeNegativeTest-499422654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:31:39 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0ef37754-b65b-4d9f-bdf2-fcf2ccd817a8 tempest-AttachVolumeNegativeTest-499422654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:31:39 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0ef37754-b65b-4d9f-bdf2-fcf2ccd817a8 tempest-AttachVolumeNegativeTest-499422654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:31:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0ef37754-b65b-4d9f-bdf2-fcf2ccd817a8 tempest-AttachVolumeNegativeTest-499422654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:31:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0ef37754-b65b-4d9f-bdf2-fcf2ccd817a8 tempest-AttachVolumeNegativeTest-499422654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:39 devstack sudo[94341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:31:39 devstack sudo[94341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:39 devstack sudo[94338]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-94b4a27d-a710-4702-9b1a-d422142af958 tempest-GroupsTest-1044337045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec567dae-919c-4cb1-bf94-980dee652139" returned: 0 in 0.638s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-94b4a27d-a710-4702-9b1a-d422142af958 tempest-GroupsTest-1044337045 None] Lock "cinder-quobyte-ec567dae-919c-4cb1-bf94-980dee652139" released by "delete_volume" :: held 1.465s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:31:39 devstack sudo[94335]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fb2c10b3-1cbc-4ad4-9882-b1b487c0c52b tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c" returned: 0 in 0.830s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fb2c10b3-1cbc-4ad4-9882-b1b487c0c52b tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:39 devstack sudo[94347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c Jun 04 06:31:39 devstack sudo[94347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:39 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-94b4a27d-a710-4702-9b1a-d422142af958 tempest-GroupsTest-1044337045 None] Created reservations ['bd89a2b8-1bf5-48e5-b7e3-604e432ef8b6'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:31:39 devstack cinder-volume[86069]: WARNING cinder.quota [None req-94b4a27d-a710-4702-9b1a-d422142af958 tempest-GroupsTest-1044337045 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1388568889 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1388568889, it is now deprecated. Please use the default quota class for default quota. Jun 04 06:31:39 devstack cinder-volume[86069]: WARNING cinder.quota [None req-94b4a27d-a710-4702-9b1a-d422142af958 tempest-GroupsTest-1044337045 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1388568889 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1388568889, it is now deprecated. Please use the default quota class for default quota. Jun 04 06:31:40 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-94b4a27d-a710-4702-9b1a-d422142af958 tempest-GroupsTest-1044337045 None] Created reservations ['d3fc06be-9173-4158-8b69-c836aba59df9', '599f3b04-9fb1-42b6-8a1f-c7506be3db14', '415b3e79-6fe7-4687-b5c1-be7fca99e8c8', '480e8dd9-cc05-4761-87b6-6c37b567f99e'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:31:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-94b4a27d-a710-4702-9b1a-d422142af958 tempest-GroupsTest-1044337045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:31:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-94b4a27d-a710-4702-9b1a-d422142af958 tempest-GroupsTest-1044337045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:31:40 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-94b4a27d-a710-4702-9b1a-d422142af958 tempest-GroupsTest-1044337045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:31:40 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-94b4a27d-a710-4702-9b1a-d422142af958 tempest-GroupsTest-1044337045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:31:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-94b4a27d-a710-4702-9b1a-d422142af958 tempest-GroupsTest-1044337045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:31:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-94b4a27d-a710-4702-9b1a-d422142af958 tempest-GroupsTest-1044337045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:40 devstack sudo[94349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:31:40 devstack sudo[94349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:40 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-e44bd6e7-de30-434f-87a2-f5d101f55547 tempest-AttachVolumeNegativeTest-499422654 None] Acquiring lock "cinder-493151b7-5ffa-4c77-92a1-7c09178b2036-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:31:40 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-e44bd6e7-de30-434f-87a2-f5d101f55547 tempest-AttachVolumeNegativeTest-499422654 None] Lock "cinder-493151b7-5ffa-4c77-92a1-7c09178b2036-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:31:40 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-e44bd6e7-de30-434f-87a2-f5d101f55547 tempest-AttachVolumeNegativeTest-499422654 None] Acquiring lock "cinder-quobyte-493151b7-5ffa-4c77-92a1-7c09178b2036" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:31:40 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-e44bd6e7-de30-434f-87a2-f5d101f55547 tempest-AttachVolumeNegativeTest-499422654 None] Lock "cinder-quobyte-493151b7-5ffa-4c77-92a1-7c09178b2036" acquired by "delete_volume" :: waited 0.028s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:31:40 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aefc558-0cbe-4ada-8eb6-41f1f07e2f5d]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:31:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e44bd6e7-de30-434f-87a2-f5d101f55547 tempest-AttachVolumeNegativeTest-499422654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-493151b7-5ffa-4c77-92a1-7c09178b2036 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:40 devstack sudo[94341]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0ef37754-b65b-4d9f-bdf2-fcf2ccd817a8 tempest-AttachVolumeNegativeTest-499422654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.864s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:40 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-0ef37754-b65b-4d9f-bdf2-fcf2ccd817a8 tempest-AttachVolumeNegativeTest-499422654 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:31:40 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-0ef37754-b65b-4d9f-bdf2-fcf2ccd817a8 tempest-AttachVolumeNegativeTest-499422654 None] Deleted volume successfully. Jun 04 06:31:40 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0ef37754-b65b-4d9f-bdf2-fcf2ccd817a8 tempest-AttachVolumeNegativeTest-499422654 None] Lock "cinder-b24563fc-a785-4b42-af32-872643efe470-delete_volume" released by "delete_volume" :: held 2.674s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:31:40 devstack sudo[94353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-493151b7-5ffa-4c77-92a1-7c09178b2036 Jun 04 06:31:40 devstack sudo[94353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:40 devstack sudo[94347]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fb2c10b3-1cbc-4ad4-9882-b1b487c0c52b tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2193e57a-54e4-4006-94d7-b4a612f8470c" returned: 0 in 1.008s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:40 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-fb2c10b3-1cbc-4ad4-9882-b1b487c0c52b tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Lock "cinder-quobyte-2193e57a-54e4-4006-94d7-b4a612f8470c" released by "delete_volume" :: held 1.915s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:31:40 devstack sudo[94349]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-94b4a27d-a710-4702-9b1a-d422142af958 tempest-GroupsTest-1044337045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.777s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:40 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-94b4a27d-a710-4702-9b1a-d422142af958 tempest-GroupsTest-1044337045 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:31:40 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-94b4a27d-a710-4702-9b1a-d422142af958 tempest-GroupsTest-1044337045 None] Delete group completed successfully. Jun 04 06:31:40 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-8423ae8f-6abc-4a6f-84f6-a7acfc94d73b tempest-GroupsTest-1044337045 None] Created reservations ['278934aa-4598-4bc8-a66e-3c2e91875ee9'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:31:40 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-fb2c10b3-1cbc-4ad4-9882-b1b487c0c52b tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Created reservations ['c5f56287-de47-45dc-9c95-3b7b31459c62', '4fbe3fc8-2a23-473b-bf77-9c81bf0645c7', '7b7cb873-9d9c-4e58-bf98-e438bd93f83e', 'a6f654bc-34c6-4951-8dd9-01b8bfe889d8'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:31:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8423ae8f-6abc-4a6f-84f6-a7acfc94d73b tempest-GroupsTest-1044337045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:31:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8423ae8f-6abc-4a6f-84f6-a7acfc94d73b tempest-GroupsTest-1044337045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:31:41 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-8423ae8f-6abc-4a6f-84f6-a7acfc94d73b tempest-GroupsTest-1044337045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:31:41 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-8423ae8f-6abc-4a6f-84f6-a7acfc94d73b tempest-GroupsTest-1044337045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:31:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8423ae8f-6abc-4a6f-84f6-a7acfc94d73b tempest-GroupsTest-1044337045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:31:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8423ae8f-6abc-4a6f-84f6-a7acfc94d73b tempest-GroupsTest-1044337045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:41 devstack sudo[94369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:31:41 devstack sudo[94369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-fb2c10b3-1cbc-4ad4-9882-b1b487c0c52b tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:31:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-fb2c10b3-1cbc-4ad4-9882-b1b487c0c52b tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:31:41 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-fb2c10b3-1cbc-4ad4-9882-b1b487c0c52b tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:31:41 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-fb2c10b3-1cbc-4ad4-9882-b1b487c0c52b tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:31:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-fb2c10b3-1cbc-4ad4-9882-b1b487c0c52b tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:31:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fb2c10b3-1cbc-4ad4-9882-b1b487c0c52b tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:41 devstack sudo[94374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:31:41 devstack sudo[94374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:41 devstack sudo[94353]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e44bd6e7-de30-434f-87a2-f5d101f55547 tempest-AttachVolumeNegativeTest-499422654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-493151b7-5ffa-4c77-92a1-7c09178b2036" returned: 0 in 0.852s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e44bd6e7-de30-434f-87a2-f5d101f55547 tempest-AttachVolumeNegativeTest-499422654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-493151b7-5ffa-4c77-92a1-7c09178b2036 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:41 devstack sudo[94379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-493151b7-5ffa-4c77-92a1-7c09178b2036 Jun 04 06:31:41 devstack sudo[94379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:41 devstack sudo[94374]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fb2c10b3-1cbc-4ad4-9882-b1b487c0c52b tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.723s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:41 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-fb2c10b3-1cbc-4ad4-9882-b1b487c0c52b tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:31:41 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-fb2c10b3-1cbc-4ad4-9882-b1b487c0c52b tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Deleted volume successfully. Jun 04 06:31:41 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-fb2c10b3-1cbc-4ad4-9882-b1b487c0c52b tempest-VolumesSnapshotNegativeTestJSON-1192136571 None] Lock "cinder-2193e57a-54e4-4006-94d7-b4a612f8470c-delete_volume" released by "delete_volume" :: held 2.953s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:31:41 devstack sudo[94369]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8423ae8f-6abc-4a6f-84f6-a7acfc94d73b tempest-GroupsTest-1044337045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.926s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:41 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-8423ae8f-6abc-4a6f-84f6-a7acfc94d73b tempest-GroupsTest-1044337045 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:31:41 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-8423ae8f-6abc-4a6f-84f6-a7acfc94d73b tempest-GroupsTest-1044337045 None] Delete group completed successfully. Jun 04 06:31:42 devstack sudo[94379]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e44bd6e7-de30-434f-87a2-f5d101f55547 tempest-AttachVolumeNegativeTest-499422654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-493151b7-5ffa-4c77-92a1-7c09178b2036" returned: 0 in 0.874s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:42 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-e44bd6e7-de30-434f-87a2-f5d101f55547 tempest-AttachVolumeNegativeTest-499422654 None] Lock "cinder-quobyte-493151b7-5ffa-4c77-92a1-7c09178b2036" released by "delete_volume" :: held 1.805s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:31:42 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-e44bd6e7-de30-434f-87a2-f5d101f55547 tempest-AttachVolumeNegativeTest-499422654 None] Created reservations ['c797341e-5ad5-4b1c-9b29-312190255025', 'b5840967-2c07-4eec-8513-1437b42a6120', 'bb0b3474-1837-4850-aeab-300bca9af5aa', 'cbc87c2d-11af-45d0-81ca-0c31b6295ac6'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:31:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e44bd6e7-de30-434f-87a2-f5d101f55547 tempest-AttachVolumeNegativeTest-499422654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:31:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e44bd6e7-de30-434f-87a2-f5d101f55547 tempest-AttachVolumeNegativeTest-499422654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:31:42 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e44bd6e7-de30-434f-87a2-f5d101f55547 tempest-AttachVolumeNegativeTest-499422654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:31:42 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e44bd6e7-de30-434f-87a2-f5d101f55547 tempest-AttachVolumeNegativeTest-499422654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:31:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e44bd6e7-de30-434f-87a2-f5d101f55547 tempest-AttachVolumeNegativeTest-499422654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:31:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e44bd6e7-de30-434f-87a2-f5d101f55547 tempest-AttachVolumeNegativeTest-499422654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:42 devstack sudo[94451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:31:42 devstack sudo[94451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:42 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-5817c967-04c7-47ee-a283-2803037ca3d1 tempest-GroupsTest-1044337045 None] Group tempest-GroupsTest-Group-1910446556: creating Jun 04 06:31:42 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-5817c967-04c7-47ee-a283-2803037ca3d1 tempest-GroupsTest-1044337045 None] Group tempest-GroupsTest-Group-1910446556: created successfully Jun 04 06:31:42 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-5817c967-04c7-47ee-a283-2803037ca3d1 tempest-GroupsTest-1044337045 None] Create group completed successfully. Jun 04 06:31:42 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-300d70c6-655a-48bb-b94b-9f70ad09cb40 tempest-AttachVolumeNegativeTest-499422654 None] Acquiring lock "cinder-dc72449b-03be-4ca4-83f3-8b01f3933346-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:31:43 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-300d70c6-655a-48bb-b94b-9f70ad09cb40 tempest-AttachVolumeNegativeTest-499422654 None] Lock "cinder-dc72449b-03be-4ca4-83f3-8b01f3933346-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:31:43 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-300d70c6-655a-48bb-b94b-9f70ad09cb40 tempest-AttachVolumeNegativeTest-499422654 None] Acquiring lock "cinder-quobyte-dc72449b-03be-4ca4-83f3-8b01f3933346" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:31:43 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-300d70c6-655a-48bb-b94b-9f70ad09cb40 tempest-AttachVolumeNegativeTest-499422654 None] Lock "cinder-quobyte-dc72449b-03be-4ca4-83f3-8b01f3933346" acquired by "delete_volume" :: waited 0.017s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:31:43 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f11a92-28ff-41ca-ba0c-cbcebf8aa2e2]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:31:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-300d70c6-655a-48bb-b94b-9f70ad09cb40 tempest-AttachVolumeNegativeTest-499422654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dc72449b-03be-4ca4-83f3-8b01f3933346 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:43 devstack sudo[94451]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e44bd6e7-de30-434f-87a2-f5d101f55547 tempest-AttachVolumeNegativeTest-499422654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.781s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:43 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-e44bd6e7-de30-434f-87a2-f5d101f55547 tempest-AttachVolumeNegativeTest-499422654 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:31:43 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-e44bd6e7-de30-434f-87a2-f5d101f55547 tempest-AttachVolumeNegativeTest-499422654 None] Deleted volume successfully. Jun 04 06:31:43 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-e44bd6e7-de30-434f-87a2-f5d101f55547 tempest-AttachVolumeNegativeTest-499422654 None] Lock "cinder-493151b7-5ffa-4c77-92a1-7c09178b2036-delete_volume" released by "delete_volume" :: held 2.855s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:31:43 devstack sudo[94457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dc72449b-03be-4ca4-83f3-8b01f3933346 Jun 04 06:31:43 devstack sudo[94457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:43 devstack sudo[94457]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-300d70c6-655a-48bb-b94b-9f70ad09cb40 tempest-AttachVolumeNegativeTest-499422654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dc72449b-03be-4ca4-83f3-8b01f3933346" returned: 0 in 0.751s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-300d70c6-655a-48bb-b94b-9f70ad09cb40 tempest-AttachVolumeNegativeTest-499422654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dc72449b-03be-4ca4-83f3-8b01f3933346 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:43 devstack sudo[94463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dc72449b-03be-4ca4-83f3-8b01f3933346 Jun 04 06:31:43 devstack sudo[94463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:44 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:31:44 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] Flow 'volume_create_manager' (b3951465-3f8f-42a0-abf2-7bdcda11b33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:31:44 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa2a9625-eb84-4f54-9832-47e553ea03b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:31:44 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa2a9625-eb84-4f54-9832-47e553ea03b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1851195942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7140e8c-60b2-4f53-ac12-ae7859adf023,host='devstack@QuobyteHD#QuobyteHD',id=6e000fc1-30b4-42ca-8caf-895de0c0838d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4e535c8223484189316599e1e6c003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:31:44Z,use_quota=True,user_id='d7a6410264f4448cb2ffca96a282bf49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2244ebc-e4ad-4f07-b56c-8a419b30fcc3),volume_type_id=d2244ebc-e4ad-4f07-b56c-8a419b30fcc3)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:31:44 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99122c94-9f0e-48b7-bd13-e652dc50ea9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:31:44 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99122c94-9f0e-48b7-bd13-e652dc50ea9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:31:44 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e739535f-6e7d-4b2a-9d80-a9608db879df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:31:44 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e739535f-6e7d-4b2a-9d80-a9608db879df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e000fc1-30b4-42ca-8caf-895de0c0838d', 'volume_name': 'volume-6e000fc1-30b4-42ca-8caf-895de0c0838d', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:31:44 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4322589c-2b09-4b17-95d9-2247319e491d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:31:44 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4322589c-2b09-4b17-95d9-2247319e491d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:31:44 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1b43f1c-c87a-4040-aad6-6a45de4f89a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:31:44 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] Volume 6e000fc1-30b4-42ca-8caf-895de0c0838d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e000fc1-30b4-42ca-8caf-895de0c0838d', 'volume_size': 1} Jun 04 06:31:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:31:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:31:44 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f7140e8c-60b2-4f53-ac12-ae7859adf023,created_at=2026-06-04T04:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1851195942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7140e8c-60b2-4f53-ac12-ae7859adf023,host='devstack@QuobyteHD#QuobyteHD',id=6e000fc1-30b4-42ca-8caf-895de0c0838d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4e535c8223484189316599e1e6c003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:31:44Z,use_quota=True,user_id='d7a6410264f4448cb2ffca96a282bf49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2244ebc-e4ad-4f07-b56c-8a419b30fcc3),volume_type_id=d2244ebc-e4ad-4f07-b56c-8a419b30fcc3)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:31:44 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] Creating volume 6e000fc1-30b4-42ca-8caf-895de0c0838d {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:31:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:31:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:31:44 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:31:44 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:31:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:31:44 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:31:44 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:31:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-6e000fc1-30b4-42ca-8caf-895de0c0838d 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:44 devstack sudo[94799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-6e000fc1-30b4-42ca-8caf-895de0c0838d 1073741824 Jun 04 06:31:44 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:44 devstack sudo[94463]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-300d70c6-655a-48bb-b94b-9f70ad09cb40 tempest-AttachVolumeNegativeTest-499422654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dc72449b-03be-4ca4-83f3-8b01f3933346" returned: 0 in 0.989s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:44 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-300d70c6-655a-48bb-b94b-9f70ad09cb40 tempest-AttachVolumeNegativeTest-499422654 None] Lock "cinder-quobyte-dc72449b-03be-4ca4-83f3-8b01f3933346" released by "delete_volume" :: held 1.810s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:31:44 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-300d70c6-655a-48bb-b94b-9f70ad09cb40 tempest-AttachVolumeNegativeTest-499422654 None] Created reservations ['51715bf4-3e07-4a9a-a275-0cc8a2e12370', 'af103727-636a-4dbb-ab53-b47abf13df8a', '73176f74-a0c1-4b6c-9818-c6c918540bf8', 'e8069506-500c-478f-9cea-f16ad4d3ab9e'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:31:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-300d70c6-655a-48bb-b94b-9f70ad09cb40 tempest-AttachVolumeNegativeTest-499422654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:31:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-300d70c6-655a-48bb-b94b-9f70ad09cb40 tempest-AttachVolumeNegativeTest-499422654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:31:45 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-300d70c6-655a-48bb-b94b-9f70ad09cb40 tempest-AttachVolumeNegativeTest-499422654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:31:45 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-300d70c6-655a-48bb-b94b-9f70ad09cb40 tempest-AttachVolumeNegativeTest-499422654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:31:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-300d70c6-655a-48bb-b94b-9f70ad09cb40 tempest-AttachVolumeNegativeTest-499422654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:31:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-300d70c6-655a-48bb-b94b-9f70ad09cb40 tempest-AttachVolumeNegativeTest-499422654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:45 devstack sudo[94818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:31:45 devstack sudo[94818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:46 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-6e000fc1-30b4-42ca-8caf-895de0c0838d 1073741824" returned: 0 in 1.467s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-6e000fc1-30b4-42ca-8caf-895de0c0838d {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:46 devstack sudo[94826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-6e000fc1-30b4-42ca-8caf-895de0c0838d Jun 04 06:31:46 devstack sudo[94826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:46 devstack sudo[94818]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-300d70c6-655a-48bb-b94b-9f70ad09cb40 tempest-AttachVolumeNegativeTest-499422654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.243s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:46 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-300d70c6-655a-48bb-b94b-9f70ad09cb40 tempest-AttachVolumeNegativeTest-499422654 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:31:46 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-300d70c6-655a-48bb-b94b-9f70ad09cb40 tempest-AttachVolumeNegativeTest-499422654 None] Deleted volume successfully. Jun 04 06:31:46 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-300d70c6-655a-48bb-b94b-9f70ad09cb40 tempest-AttachVolumeNegativeTest-499422654 None] Lock "cinder-dc72449b-03be-4ca4-83f3-8b01f3933346-delete_volume" released by "delete_volume" :: held 3.399s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:31:47 devstack sudo[94826]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-6e000fc1-30b4-42ca-8caf-895de0c0838d" returned: 0 in 0.918s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:47 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] <== create_volume: return (2473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:31:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.476s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:31:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1b43f1c-c87a-4040-aad6-6a45de4f89a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e000fc1-30b4-42ca-8caf-895de0c0838d', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:31:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07d063c5-a6ad-49b2-ab59-a2f41dec3505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:31:47 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] Volume volume-6e000fc1-30b4-42ca-8caf-895de0c0838d (6e000fc1-30b4-42ca-8caf-895de0c0838d): created successfully Jun 04 06:31:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07d063c5-a6ad-49b2-ab59-a2f41dec3505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:31:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] Flow 'volume_create_manager' (b3951465-3f8f-42a0-abf2-7bdcda11b33b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:31:47 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-ce29e5b8-06ac-4187-9634-1185b168f62a tempest-GroupsTest-1044337045 None] Created volume successfully. Jun 04 06:31:49 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:31:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] Flow 'volume_create_manager' (eb06aea8-7438-4ef4-8bb4-63855a65f3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:31:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3524b472-9807-4b5d-9bf2-fcd34094742c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:31:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3524b472-9807-4b5d-9bf2-fcd34094742c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1888628183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7140e8c-60b2-4f53-ac12-ae7859adf023,host='devstack@QuobyteHD#QuobyteHD',id=32ec51e1-d6a3-4a3e-93af-d9b95fa14a51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4e535c8223484189316599e1e6c003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:31:49Z,use_quota=True,user_id='d7a6410264f4448cb2ffca96a282bf49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2244ebc-e4ad-4f07-b56c-8a419b30fcc3),volume_type_id=d2244ebc-e4ad-4f07-b56c-8a419b30fcc3)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:31:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c72f0d66-9f2b-44a2-94b8-34191cb1eac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:31:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c72f0d66-9f2b-44a2-94b8-34191cb1eac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:31:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3f5ec23-f97f-4c0b-87a2-25cbfb3435fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:31:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3f5ec23-f97f-4c0b-87a2-25cbfb3435fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32ec51e1-d6a3-4a3e-93af-d9b95fa14a51', 'volume_name': 'volume-32ec51e1-d6a3-4a3e-93af-d9b95fa14a51', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:31:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e03b4fa-32b9-4ca5-b678-fd4ad9a2a401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:31:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e03b4fa-32b9-4ca5-b678-fd4ad9a2a401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:31:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59ed28f6-dfeb-4a2e-bf3e-54fae750d6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:31:49 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] Volume 32ec51e1-d6a3-4a3e-93af-d9b95fa14a51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32ec51e1-d6a3-4a3e-93af-d9b95fa14a51', 'volume_size': 1} Jun 04 06:31:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:31:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:31:49 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f7140e8c-60b2-4f53-ac12-ae7859adf023,created_at=2026-06-04T04:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1888628183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7140e8c-60b2-4f53-ac12-ae7859adf023,host='devstack@QuobyteHD#QuobyteHD',id=32ec51e1-d6a3-4a3e-93af-d9b95fa14a51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4e535c8223484189316599e1e6c003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:31:49Z,use_quota=True,user_id='d7a6410264f4448cb2ffca96a282bf49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2244ebc-e4ad-4f07-b56c-8a419b30fcc3),volume_type_id=d2244ebc-e4ad-4f07-b56c-8a419b30fcc3)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:31:49 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] Creating volume 32ec51e1-d6a3-4a3e-93af-d9b95fa14a51 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:31:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:31:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:31:49 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:31:49 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:31:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:31:49 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:31:49 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:31:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-32ec51e1-d6a3-4a3e-93af-d9b95fa14a51 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:49 devstack sudo[94832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-32ec51e1-d6a3-4a3e-93af-d9b95fa14a51 1073741824 Jun 04 06:31:49 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:50 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-32ec51e1-d6a3-4a3e-93af-d9b95fa14a51 1073741824" returned: 0 in 1.279s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:50 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=108,cinder:UPDATE=106,cinder:INSERT=25,cinder:DELETE=5 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:31:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-32ec51e1-d6a3-4a3e-93af-d9b95fa14a51 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:50 devstack sudo[94840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-32ec51e1-d6a3-4a3e-93af-d9b95fa14a51 Jun 04 06:31:50 devstack sudo[94840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:51 devstack sudo[94840]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-32ec51e1-d6a3-4a3e-93af-d9b95fa14a51" returned: 0 in 0.888s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:51 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] <== create_volume: return (2247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:31:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.250s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:31:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59ed28f6-dfeb-4a2e-bf3e-54fae750d6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32ec51e1-d6a3-4a3e-93af-d9b95fa14a51', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:31:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0158cd63-de7b-4e24-bfc8-94182ddf256f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:31:51 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] Volume volume-32ec51e1-d6a3-4a3e-93af-d9b95fa14a51 (32ec51e1-d6a3-4a3e-93af-d9b95fa14a51): created successfully Jun 04 06:31:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0158cd63-de7b-4e24-bfc8-94182ddf256f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:31:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] Flow 'volume_create_manager' (eb06aea8-7438-4ef4-8bb4-63855a65f3b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:31:51 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-c61553fe-3d8b-4515-adbe-36d62e04fb5c tempest-GroupsTest-1044337045 None] Created volume successfully. Jun 04 06:31:53 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-73512168-eb2f-4eb5-8a06-05a52d990438 tempest-GroupsTest-1044337045 None] Update group completed successfully. Jun 04 06:31:54 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-8edb78f5-8a9d-41b9-a813-370f83c17e7f tempest-GroupsTest-1044337045 None] Update group completed successfully. Jun 04 06:31:56 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-62e287c0-6c46-4f88-9cef-8d210e49f353 tempest-GroupsTest-1044337045 None] Acquiring lock "cinder-quobyte-32ec51e1-d6a3-4a3e-93af-d9b95fa14a51" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:31:56 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-62e287c0-6c46-4f88-9cef-8d210e49f353 tempest-GroupsTest-1044337045 None] Lock "cinder-quobyte-32ec51e1-d6a3-4a3e-93af-d9b95fa14a51" acquired by "delete_volume" :: waited 0.043s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:31:56 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7060b0-167a-4e6a-bedb-6dd25519ae88]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:31:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-62e287c0-6c46-4f88-9cef-8d210e49f353 tempest-GroupsTest-1044337045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-32ec51e1-d6a3-4a3e-93af-d9b95fa14a51 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:56 devstack sudo[94848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-32ec51e1-d6a3-4a3e-93af-d9b95fa14a51 Jun 04 06:31:56 devstack sudo[94848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:57 devstack sudo[94848]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-62e287c0-6c46-4f88-9cef-8d210e49f353 tempest-GroupsTest-1044337045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-32ec51e1-d6a3-4a3e-93af-d9b95fa14a51" returned: 0 in 1.385s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-62e287c0-6c46-4f88-9cef-8d210e49f353 tempest-GroupsTest-1044337045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-32ec51e1-d6a3-4a3e-93af-d9b95fa14a51 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:57 devstack sudo[94853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-32ec51e1-d6a3-4a3e-93af-d9b95fa14a51 Jun 04 06:31:57 devstack sudo[94853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:31:58 devstack sudo[94853]: pam_unix(sudo:session): session closed for user root Jun 04 06:31:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-62e287c0-6c46-4f88-9cef-8d210e49f353 tempest-GroupsTest-1044337045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-32ec51e1-d6a3-4a3e-93af-d9b95fa14a51" returned: 0 in 1.101s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:31:59 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-62e287c0-6c46-4f88-9cef-8d210e49f353 tempest-GroupsTest-1044337045 None] Lock "cinder-quobyte-32ec51e1-d6a3-4a3e-93af-d9b95fa14a51" released by "delete_volume" :: held 2.563s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:31:59 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-62e287c0-6c46-4f88-9cef-8d210e49f353 tempest-GroupsTest-1044337045 None] Acquiring lock "cinder-quobyte-6e000fc1-30b4-42ca-8caf-895de0c0838d" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:31:59 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-62e287c0-6c46-4f88-9cef-8d210e49f353 tempest-GroupsTest-1044337045 None] Lock "cinder-quobyte-6e000fc1-30b4-42ca-8caf-895de0c0838d" acquired by "delete_volume" :: waited 0.038s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:31:59 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[593ba108-5856-40a4-aa90-0a0fde321c4b]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:31:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-62e287c0-6c46-4f88-9cef-8d210e49f353 tempest-GroupsTest-1044337045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-6e000fc1-30b4-42ca-8caf-895de0c0838d {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:31:59 devstack sudo[94860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-6e000fc1-30b4-42ca-8caf-895de0c0838d Jun 04 06:31:59 devstack sudo[94860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:00 devstack sudo[94860]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-62e287c0-6c46-4f88-9cef-8d210e49f353 tempest-GroupsTest-1044337045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-6e000fc1-30b4-42ca-8caf-895de0c0838d" returned: 0 in 0.955s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-62e287c0-6c46-4f88-9cef-8d210e49f353 tempest-GroupsTest-1044337045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-6e000fc1-30b4-42ca-8caf-895de0c0838d {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:00 devstack sudo[94885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-6e000fc1-30b4-42ca-8caf-895de0c0838d Jun 04 06:32:00 devstack sudo[94885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:00 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:32:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] Flow 'volume_create_manager' (fc4b258c-10a5-4d47-805e-df2a57c0f0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:32:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a8a6989-cc3a-4eed-b906-17632322b6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a8a6989-cc3a-4eed-b906-17632322b6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1484869012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccdc474f-64fc-4da8-8cf7-9d611e5637fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5d0706963374f38a44d596612bc3341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:32:00Z,use_quota=True,user_id='7fd939dd8e944f288e2c36516eaaa572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc7ece06-e84a-4865-9479-aa4580d8b5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc7ece06-e84a-4865-9479-aa4580d8b5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5501f1f9-6e7f-4f3d-af4e-0430a06bc3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5501f1f9-6e7f-4f3d-af4e-0430a06bc3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccdc474f-64fc-4da8-8cf7-9d611e5637fc', 'volume_name': 'volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928436c9-9c19-4d0e-adf4-6b029a3418f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928436c9-9c19-4d0e-adf4-6b029a3418f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcdf1e0f-1a2a-4b0b-bb97-51c259b5f167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:00 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] Volume ccdc474f-64fc-4da8-8cf7-9d611e5637fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc', 'volume_size': 1} Jun 04 06:32:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:32:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:32:00 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1484869012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccdc474f-64fc-4da8-8cf7-9d611e5637fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5d0706963374f38a44d596612bc3341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:32:00Z,use_quota=True,user_id='7fd939dd8e944f288e2c36516eaaa572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:32:00 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] Creating volume ccdc474f-64fc-4da8-8cf7-9d611e5637fc {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:32:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:32:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:32:00 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:32:00 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:32:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:32:00 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:32:00 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:32:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:00 devstack sudo[94887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc 1073741824 Jun 04 06:32:00 devstack sudo[94887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:00 devstack sudo[94885]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-62e287c0-6c46-4f88-9cef-8d210e49f353 tempest-GroupsTest-1044337045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-6e000fc1-30b4-42ca-8caf-895de0c0838d" returned: 0 in 0.801s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:00 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-62e287c0-6c46-4f88-9cef-8d210e49f353 tempest-GroupsTest-1044337045 None] Lock "cinder-quobyte-6e000fc1-30b4-42ca-8caf-895de0c0838d" released by "delete_volume" :: held 1.839s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:32:00 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-62e287c0-6c46-4f88-9cef-8d210e49f353 tempest-GroupsTest-1044337045 None] Created reservations ['4acbaf32-d538-432f-93fe-6827e5c9123f'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:32:01 devstack cinder-volume[86069]: WARNING cinder.quota [None req-62e287c0-6c46-4f88-9cef-8d210e49f353 tempest-GroupsTest-1044337045 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1173914425 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1173914425, it is now deprecated. Please use the default quota class for default quota. Jun 04 06:32:01 devstack cinder-volume[86069]: WARNING cinder.quota [None req-62e287c0-6c46-4f88-9cef-8d210e49f353 tempest-GroupsTest-1044337045 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1173914425 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1173914425, it is now deprecated. Please use the default quota class for default quota. Jun 04 06:32:01 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-62e287c0-6c46-4f88-9cef-8d210e49f353 tempest-GroupsTest-1044337045 None] Created reservations ['d1869ff6-37a1-4585-b428-712b77fb0d7e', '4b90f8d2-cf88-4fd4-8be6-570d5edbd19d', 'b45a071a-f5ec-45e4-a4ef-d1bafbc82d3b', 'f2ee4276-1eb3-43b5-960c-51e9eb70cd27'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:32:01 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-62e287c0-6c46-4f88-9cef-8d210e49f353 tempest-GroupsTest-1044337045 None] Created reservations ['313e6c7b-39c9-447a-9b20-32ce9e249e79', '52ac6f73-1b3a-473f-a130-a8fb7d49dd5e', '981f0af2-ebb1-47b0-95e6-08130c51a716', 'ca26ff9a-e807-485e-8fb2-8dd1c779284d'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:32:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-62e287c0-6c46-4f88-9cef-8d210e49f353 tempest-GroupsTest-1044337045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:32:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-62e287c0-6c46-4f88-9cef-8d210e49f353 tempest-GroupsTest-1044337045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:32:01 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-62e287c0-6c46-4f88-9cef-8d210e49f353 tempest-GroupsTest-1044337045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:32:01 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-62e287c0-6c46-4f88-9cef-8d210e49f353 tempest-GroupsTest-1044337045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:32:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-62e287c0-6c46-4f88-9cef-8d210e49f353 tempest-GroupsTest-1044337045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:32:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-62e287c0-6c46-4f88-9cef-8d210e49f353 tempest-GroupsTest-1044337045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:01 devstack sudo[94894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:32:01 devstack sudo[94894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:01 devstack sudo[94887]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc 1073741824" returned: 0 in 1.084s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:01 devstack sudo[94896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc Jun 04 06:32:01 devstack sudo[94896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:02 devstack sudo[94894]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-62e287c0-6c46-4f88-9cef-8d210e49f353 tempest-GroupsTest-1044337045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.721s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:02 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-62e287c0-6c46-4f88-9cef-8d210e49f353 tempest-GroupsTest-1044337045 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:32:02 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-62e287c0-6c46-4f88-9cef-8d210e49f353 tempest-GroupsTest-1044337045 None] Delete group completed successfully. Jun 04 06:32:02 devstack sudo[94896]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc" returned: 0 in 0.700s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:02 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] <== create_volume: return (1833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:32:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:32:02 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcdf1e0f-1a2a-4b0b-bb97-51c259b5f167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:02 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c25ea3-89fb-4910-b8da-3ce76d0ac9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:02 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] Volume volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc (ccdc474f-64fc-4da8-8cf7-9d611e5637fc): created successfully Jun 04 06:32:02 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c25ea3-89fb-4910-b8da-3ce76d0ac9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:02 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] Flow 'volume_create_manager' (fc4b258c-10a5-4d47-805e-df2a57c0f0af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:32:02 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-beb25efa-5551-4bbe-96ce-a538fa69e004 req-40679f04-fa64-4b7b-b269-a1beabf8b592 tempest-VolumesSnapshotsTestJSON-1270646143 None] Created volume successfully. Jun 04 06:32:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-8ddd976f-8fce-40c2-8fc1-915e1f1f5880 req-9a13d09d-4075-4d49-bc53-359af7789540 tempest-VolumesSnapshotsTestJSON-1270646143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:32:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-8ddd976f-8fce-40c2-8fc1-915e1f1f5880 req-9a13d09d-4075-4d49-bc53-359af7789540 tempest-VolumesSnapshotsTestJSON-1270646143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:32:03 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [req-8ddd976f-8fce-40c2-8fc1-915e1f1f5880 req-9a13d09d-4075-4d49-bc53-359af7789540 tempest-VolumesSnapshotsTestJSON-1270646143 None] Creating offline snapshot af74fb30-6f55-44f1-8490-d206474d9416 of volume ccdc474f-64fc-4da8-8cf7-9d611e5637fc {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:32:03 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a395a3-d5a2-4fbe-8a54-49695e509960]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:32:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-8ddd976f-8fce-40c2-8fc1-915e1f1f5880 req-9a13d09d-4075-4d49-bc53-359af7789540 tempest-VolumesSnapshotsTestJSON-1270646143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:03 devstack sudo[94924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc Jun 04 06:32:03 devstack sudo[94924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:04 devstack sudo[94924]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-8ddd976f-8fce-40c2-8fc1-915e1f1f5880 req-9a13d09d-4075-4d49-bc53-359af7789540 tempest-VolumesSnapshotsTestJSON-1270646143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc" returned: 0 in 1.010s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-8ddd976f-8fce-40c2-8fc1-915e1f1f5880 req-9a13d09d-4075-4d49-bc53-359af7789540 tempest-VolumesSnapshotsTestJSON-1270646143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc.af74fb30-6f55-44f1-8490-d206474d9416 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:04 devstack sudo[94931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc.af74fb30-6f55-44f1-8490-d206474d9416 1G Jun 04 06:32:04 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:05 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-8ddd976f-8fce-40c2-8fc1-915e1f1f5880 req-9a13d09d-4075-4d49-bc53-359af7789540 tempest-VolumesSnapshotsTestJSON-1270646143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc.af74fb30-6f55-44f1-8490-d206474d9416 1G" returned: 0 in 1.063s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-8ddd976f-8fce-40c2-8fc1-915e1f1f5880 req-9a13d09d-4075-4d49-bc53-359af7789540 tempest-VolumesSnapshotsTestJSON-1270646143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc.af74fb30-6f55-44f1-8490-d206474d9416 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:05 devstack sudo[94944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc.af74fb30-6f55-44f1-8490-d206474d9416 Jun 04 06:32:05 devstack sudo[94944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:06 devstack sudo[94944]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-8ddd976f-8fce-40c2-8fc1-915e1f1f5880 req-9a13d09d-4075-4d49-bc53-359af7789540 tempest-VolumesSnapshotsTestJSON-1270646143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc.af74fb30-6f55-44f1-8490-d206474d9416" returned: 0 in 1.151s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:06 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [req-8ddd976f-8fce-40c2-8fc1-915e1f1f5880 req-9a13d09d-4075-4d49-bc53-359af7789540 tempest-VolumesSnapshotsTestJSON-1270646143 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc.af74fb30-6f55-44f1-8490-d206474d9416 is being set with open permissions: ugo+rw Jun 04 06:32:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-8ddd976f-8fce-40c2-8fc1-915e1f1f5880 req-9a13d09d-4075-4d49-bc53-359af7789540 tempest-VolumesSnapshotsTestJSON-1270646143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc.af74fb30-6f55-44f1-8490-d206474d9416 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:06 devstack sudo[94955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc.af74fb30-6f55-44f1-8490-d206474d9416 Jun 04 06:32:06 devstack sudo[94955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:07 devstack sudo[94955]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-8ddd976f-8fce-40c2-8fc1-915e1f1f5880 req-9a13d09d-4075-4d49-bc53-359af7789540 tempest-VolumesSnapshotsTestJSON-1270646143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc.af74fb30-6f55-44f1-8490-d206474d9416" returned: 0 in 0.924s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-8ddd976f-8fce-40c2-8fc1-915e1f1f5880 req-9a13d09d-4075-4d49-bc53-359af7789540 tempest-VolumesSnapshotsTestJSON-1270646143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:07 devstack sudo[94960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc.info Jun 04 06:32:07 devstack sudo[94960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:08 devstack sudo[94960]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-8ddd976f-8fce-40c2-8fc1-915e1f1f5880 req-9a13d09d-4075-4d49-bc53-359af7789540 tempest-VolumesSnapshotsTestJSON-1270646143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc.info" returned: 0 in 1.092s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:08 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [req-8ddd976f-8fce-40c2-8fc1-915e1f1f5880 req-9a13d09d-4075-4d49-bc53-359af7789540 tempest-VolumesSnapshotsTestJSON-1270646143 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc.info is being set with open permissions: ugo+rw Jun 04 06:32:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-8ddd976f-8fce-40c2-8fc1-915e1f1f5880 req-9a13d09d-4075-4d49-bc53-359af7789540 tempest-VolumesSnapshotsTestJSON-1270646143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:08 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc.info Jun 04 06:32:08 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:09 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-8ddd976f-8fce-40c2-8fc1-915e1f1f5880 req-9a13d09d-4075-4d49-bc53-359af7789540 tempest-VolumesSnapshotsTestJSON-1270646143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc.info" returned: 0 in 0.944s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-8ddd976f-8fce-40c2-8fc1-915e1f1f5880 req-9a13d09d-4075-4d49-bc53-359af7789540 tempest-VolumesSnapshotsTestJSON-1270646143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.344s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:32:09 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:UPDATE=131,cinder:INSERT=30,cinder:SELECT=124,cinder:DELETE=5 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:32:09 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-8ddd976f-8fce-40c2-8fc1-915e1f1f5880 req-9a13d09d-4075-4d49-bc53-359af7789540 tempest-VolumesSnapshotsTestJSON-1270646143 None] Create snapshot completed successfully Jun 04 06:32:10 devstack cinder-volume[86069]: DEBUG cinder.coordination [req-143dc06b-e5cc-4d0f-a342-6bbd6dfe05b3 req-25a9322b-f739-4587-b6c7-f577d279a473 tempest-VolumesSnapshotsTestJSON-1270646143 None] Acquiring lock "cinder-af74fb30-6f55-44f1-8490-d206474d9416-delete_snapshot" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:32:10 devstack cinder-volume[86069]: DEBUG cinder.coordination [req-143dc06b-e5cc-4d0f-a342-6bbd6dfe05b3 req-25a9322b-f739-4587-b6c7-f577d279a473 tempest-VolumesSnapshotsTestJSON-1270646143 None] Lock "cinder-af74fb30-6f55-44f1-8490-d206474d9416-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:32:10 devstack cinder-volume[86069]: DEBUG cinder.coordination [req-143dc06b-e5cc-4d0f-a342-6bbd6dfe05b3 req-25a9322b-f739-4587-b6c7-f577d279a473 tempest-VolumesSnapshotsTestJSON-1270646143 None] Acquiring lock "cinder-quobyte-ccdc474f-64fc-4da8-8cf7-9d611e5637fc" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:32:10 devstack cinder-volume[86069]: DEBUG cinder.coordination [req-143dc06b-e5cc-4d0f-a342-6bbd6dfe05b3 req-25a9322b-f739-4587-b6c7-f577d279a473 tempest-VolumesSnapshotsTestJSON-1270646143 None] Lock "cinder-quobyte-ccdc474f-64fc-4da8-8cf7-9d611e5637fc" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:32:10 devstack cinder-volume[86069]: DEBUG cinder.coordination [req-143dc06b-e5cc-4d0f-a342-6bbd6dfe05b3 req-25a9322b-f739-4587-b6c7-f577d279a473 tempest-VolumesSnapshotsTestJSON-1270646143 None] Acquiring lock "cinder-quobyte-af74fb30-6f55-44f1-8490-d206474d9416" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:32:10 devstack cinder-volume[86069]: DEBUG cinder.coordination [req-143dc06b-e5cc-4d0f-a342-6bbd6dfe05b3 req-25a9322b-f739-4587-b6c7-f577d279a473 tempest-VolumesSnapshotsTestJSON-1270646143 None] Lock "cinder-quobyte-af74fb30-6f55-44f1-8490-d206474d9416" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:32:10 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [req-143dc06b-e5cc-4d0f-a342-6bbd6dfe05b3 req-25a9322b-f739-4587-b6c7-f577d279a473 tempest-VolumesSnapshotsTestJSON-1270646143 None] Deleting offline snapshot af74fb30-6f55-44f1-8490-d206474d9416 of volume ccdc474f-64fc-4da8-8cf7-9d611e5637fc {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:32:10 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [req-143dc06b-e5cc-4d0f-a342-6bbd6dfe05b3 req-25a9322b-f739-4587-b6c7-f577d279a473 tempest-VolumesSnapshotsTestJSON-1270646143 None] snapshot_file for this snap is: volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc.af74fb30-6f55-44f1-8490-d206474d9416 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:32:10 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[b278c2d7-2392-417c-aa12-9fcb6ab5fd8a]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:32:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-143dc06b-e5cc-4d0f-a342-6bbd6dfe05b3 req-25a9322b-f739-4587-b6c7-f577d279a473 tempest-VolumesSnapshotsTestJSON-1270646143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc.af74fb30-6f55-44f1-8490-d206474d9416 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:10 devstack sudo[94966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc.af74fb30-6f55-44f1-8490-d206474d9416 Jun 04 06:32:10 devstack sudo[94966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:32:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:32:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:32:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:32:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:32:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:32:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:11 devstack sudo[94968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:32:11 devstack sudo[94968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:11 devstack sudo[94966]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-143dc06b-e5cc-4d0f-a342-6bbd6dfe05b3 req-25a9322b-f739-4587-b6c7-f577d279a473 tempest-VolumesSnapshotsTestJSON-1270646143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc.af74fb30-6f55-44f1-8490-d206474d9416" returned: 0 in 0.936s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [req-143dc06b-e5cc-4d0f-a342-6bbd6dfe05b3 req-25a9322b-f739-4587-b6c7-f577d279a473 tempest-VolumesSnapshotsTestJSON-1270646143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:32:11 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a59f73-cf37-4f6a-9bf4-cff97803b8a5]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:32:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-143dc06b-e5cc-4d0f-a342-6bbd6dfe05b3 req-25a9322b-f739-4587-b6c7-f577d279a473 tempest-VolumesSnapshotsTestJSON-1270646143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:11 devstack sudo[94973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc Jun 04 06:32:11 devstack sudo[94973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:12 devstack sudo[94968]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.075s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:12 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:32:12 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager._thread_info {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:32:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread count: 28 {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 06:32:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread info: [<_MainThread(MainThread, started 131797370544256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 06:32:12 devstack sudo[94973]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-143dc06b-e5cc-4d0f-a342-6bbd6dfe05b3 req-25a9322b-f739-4587-b6c7-f577d279a473 tempest-VolumesSnapshotsTestJSON-1270646143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc" returned: 0 in 0.969s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-143dc06b-e5cc-4d0f-a342-6bbd6dfe05b3 req-25a9322b-f739-4587-b6c7-f577d279a473 tempest-VolumesSnapshotsTestJSON-1270646143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc.af74fb30-6f55-44f1-8490-d206474d9416 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:12 devstack sudo[94981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc.af74fb30-6f55-44f1-8490-d206474d9416 Jun 04 06:32:12 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] Flow 'volume_create_manager' (c193848c-2c91-4718-9203-e083d65c803e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9a2978-03e5-4022-aa4d-f5b363e1f563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9a2978-03e5-4022-aa4d-f5b363e1f563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1401566259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=451cfba6-d340-4967-bb50-350d97344a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390afca06ac3458c8386b3d3b0f4dfd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:32:13Z,use_quota=True,user_id='87818184acf5425e80bd58a4094d52af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fec1a96-85d5-464f-b3e1-9879d0c04e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fec1a96-85d5-464f-b3e1-9879d0c04e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f14e9e1-718c-49a6-bbf8-8ece35b8819e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f14e9e1-718c-49a6-bbf8-8ece35b8819e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '451cfba6-d340-4967-bb50-350d97344a2a', 'volume_name': 'volume-451cfba6-d340-4967-bb50-350d97344a2a', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (173165d0-f1ff-44da-b89f-10693458794a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (173165d0-f1ff-44da-b89f-10693458794a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91ea58d8-7114-4454-9d92-1eefdd09e45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:13 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] Volume 451cfba6-d340-4967-bb50-350d97344a2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-451cfba6-d340-4967-bb50-350d97344a2a', 'volume_size': 1} Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1401566259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=451cfba6-d340-4967-bb50-350d97344a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390afca06ac3458c8386b3d3b0f4dfd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:32:13Z,use_quota=True,user_id='87818184acf5425e80bd58a4094d52af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] Creating volume 451cfba6-d340-4967-bb50-350d97344a2a {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:32:13 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-451cfba6-d340-4967-bb50-350d97344a2a 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:13 devstack sudo[94986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-451cfba6-d340-4967-bb50-350d97344a2a 1073741824 Jun 04 06:32:13 devstack sudo[94986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:13 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-143dc06b-e5cc-4d0f-a342-6bbd6dfe05b3 req-25a9322b-f739-4587-b6c7-f577d279a473 tempest-VolumesSnapshotsTestJSON-1270646143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc.af74fb30-6f55-44f1-8490-d206474d9416" returned: 0 in 1.130s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-143dc06b-e5cc-4d0f-a342-6bbd6dfe05b3 req-25a9322b-f739-4587-b6c7-f577d279a473 tempest-VolumesSnapshotsTestJSON-1270646143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc.af74fb30-6f55-44f1-8490-d206474d9416 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:32:13 devstack sudo[94988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc.af74fb30-6f55-44f1-8490-d206474d9416 Jun 04 06:32:13 devstack sudo[94988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] Flow 'volume_create_manager' (678d4191-4f55-4c56-bb0b-e8fb3fdbf96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81bb40f9-60aa-43de-a667-ede6ee7d73da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81bb40f9-60aa-43de-a667-ede6ee7d73da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2114975458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bdaa617-c1e6-4056-814e-3920134ce9d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390afca06ac3458c8386b3d3b0f4dfd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:32:14Z,use_quota=True,user_id='87818184acf5425e80bd58a4094d52af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a76087e-a9b1-48bc-8661-68770c58b5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a76087e-a9b1-48bc-8661-68770c58b5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c10ee73-d0da-491d-8cda-96be4e55c36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c10ee73-d0da-491d-8cda-96be4e55c36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bdaa617-c1e6-4056-814e-3920134ce9d5', 'volume_name': 'volume-9bdaa617-c1e6-4056-814e-3920134ce9d5', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b54f62a1-9ad1-484e-8063-0ca5eba74bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b54f62a1-9ad1-484e-8063-0ca5eba74bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5149b87-c1da-4df2-9a06-1b1c4e12c3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:13 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] Volume 9bdaa617-c1e6-4056-814e-3920134ce9d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bdaa617-c1e6-4056-814e-3920134ce9d5', 'volume_size': 1} Jun 04 06:32:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:32:14 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-bb9129cd-ea7b-4f77-ae28-db36790c9941 req-b5ed3eb1-ed30-42a5-87b3-b10e12a6baa1 tempest-ServerActionsTestOtherA-1981488141 None] Terminate volume connection completed successfully. Jun 04 06:32:14 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-bb9129cd-ea7b-4f77-ae28-db36790c9941 req-b5ed3eb1-ed30-42a5-87b3-b10e12a6baa1 tempest-ServerActionsTestOtherA-1981488141 None] Deleting attachment bff19bb4-7f36-436e-8ba0-6d30ce5dd8b7. {{(pid=86069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 06:32:14 devstack sudo[94988]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-143dc06b-e5cc-4d0f-a342-6bbd6dfe05b3 req-25a9322b-f739-4587-b6c7-f577d279a473 tempest-VolumesSnapshotsTestJSON-1270646143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc.af74fb30-6f55-44f1-8490-d206474d9416" returned: 0 in 0.982s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:14 devstack sudo[94986]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:14 devstack cinder-volume[86069]: DEBUG cinder.coordination [req-143dc06b-e5cc-4d0f-a342-6bbd6dfe05b3 req-25a9322b-f739-4587-b6c7-f577d279a473 tempest-VolumesSnapshotsTestJSON-1270646143 None] Lock "cinder-quobyte-af74fb30-6f55-44f1-8490-d206474d9416" released by "_delete_snapshot" :: held 4.206s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:32:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-451cfba6-d340-4967-bb50-350d97344a2a 1073741824" returned: 0 in 1.420s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:14 devstack cinder-volume[86069]: DEBUG cinder.coordination [req-143dc06b-e5cc-4d0f-a342-6bbd6dfe05b3 req-25a9322b-f739-4587-b6c7-f577d279a473 tempest-VolumesSnapshotsTestJSON-1270646143 None] Lock "cinder-quobyte-ccdc474f-64fc-4da8-8cf7-9d611e5637fc" released by "delete_snapshot" :: held 4.261s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:32:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-451cfba6-d340-4967-bb50-350d97344a2a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:14 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-451cfba6-d340-4967-bb50-350d97344a2a Jun 04 06:32:14 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:14 devstack cinder-volume[86069]: DEBUG cinder.quota [req-143dc06b-e5cc-4d0f-a342-6bbd6dfe05b3 req-25a9322b-f739-4587-b6c7-f577d279a473 tempest-VolumesSnapshotsTestJSON-1270646143 None] Created reservations ['2b93d175-75ed-4e0c-8aee-cf44c6852c8d', '5cea8186-dbd0-416d-9493-8bf60cdacc94', 'ce15313c-3bf6-474f-b5e2-ad3300d8f769', '076e9d22-1f6e-448a-9c54-d93172c174e4'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:32:14 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-143dc06b-e5cc-4d0f-a342-6bbd6dfe05b3 req-25a9322b-f739-4587-b6c7-f577d279a473 tempest-VolumesSnapshotsTestJSON-1270646143 None] Delete snapshot completed successfully. Jun 04 06:32:14 devstack cinder-volume[86069]: DEBUG cinder.coordination [req-143dc06b-e5cc-4d0f-a342-6bbd6dfe05b3 req-25a9322b-f739-4587-b6c7-f577d279a473 tempest-VolumesSnapshotsTestJSON-1270646143 None] Lock "cinder-af74fb30-6f55-44f1-8490-d206474d9416-delete_snapshot" released by "delete_snapshot" :: held 4.573s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:32:15 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-451cfba6-d340-4967-bb50-350d97344a2a" returned: 0 in 0.700s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:15 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] <== create_volume: return (2201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:32:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.204s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:32:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.666s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:32:15 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2114975458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bdaa617-c1e6-4056-814e-3920134ce9d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390afca06ac3458c8386b3d3b0f4dfd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:32:14Z,use_quota=True,user_id='87818184acf5425e80bd58a4094d52af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:32:15 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] Creating volume 9bdaa617-c1e6-4056-814e-3920134ce9d5 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:32:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:32:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:32:15 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:32:15 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:32:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:32:15 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:32:15 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:32:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9bdaa617-c1e6-4056-814e-3920134ce9d5 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91ea58d8-7114-4454-9d92-1eefdd09e45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-451cfba6-d340-4967-bb50-350d97344a2a', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:15 devstack sudo[95001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9bdaa617-c1e6-4056-814e-3920134ce9d5 1073741824 Jun 04 06:32:15 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (692dadab-2c46-49ce-9de3-66c122d91a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:15 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] Volume volume-451cfba6-d340-4967-bb50-350d97344a2a (451cfba6-d340-4967-bb50-350d97344a2a): created successfully Jun 04 06:32:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (692dadab-2c46-49ce-9de3-66c122d91a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] Flow 'volume_create_manager' (c193848c-2c91-4718-9203-e083d65c803e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:32:15 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-fcf58f02-99b0-41cc-a896-fe2aec4ff53f tempest-TestServerVolumeAttachmentScenario-549008027 None] Created volume successfully. Jun 04 06:32:16 devstack cinder-volume[86069]: DEBUG cinder.coordination [req-f4fe3236-abc8-499f-8e62-3cf9a1f0663e req-83ab66aa-2d9c-45f0-9448-7356cd7743b5 tempest-VolumesSnapshotsTestJSON-1270646143 None] Acquiring lock "cinder-ccdc474f-64fc-4da8-8cf7-9d611e5637fc-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:32:16 devstack cinder-volume[86069]: DEBUG cinder.coordination [req-f4fe3236-abc8-499f-8e62-3cf9a1f0663e req-83ab66aa-2d9c-45f0-9448-7356cd7743b5 tempest-VolumesSnapshotsTestJSON-1270646143 None] Lock "cinder-ccdc474f-64fc-4da8-8cf7-9d611e5637fc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:32:16 devstack cinder-volume[86069]: DEBUG cinder.coordination [req-f4fe3236-abc8-499f-8e62-3cf9a1f0663e req-83ab66aa-2d9c-45f0-9448-7356cd7743b5 tempest-VolumesSnapshotsTestJSON-1270646143 None] Acquiring lock "cinder-quobyte-ccdc474f-64fc-4da8-8cf7-9d611e5637fc" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:32:16 devstack cinder-volume[86069]: DEBUG cinder.coordination [req-f4fe3236-abc8-499f-8e62-3cf9a1f0663e req-83ab66aa-2d9c-45f0-9448-7356cd7743b5 tempest-VolumesSnapshotsTestJSON-1270646143 None] Lock "cinder-quobyte-ccdc474f-64fc-4da8-8cf7-9d611e5637fc" acquired by "delete_volume" :: waited 0.026s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:32:16 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f496f5b-b057-4256-9709-609a0ac890f4]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:32:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-f4fe3236-abc8-499f-8e62-3cf9a1f0663e req-83ab66aa-2d9c-45f0-9448-7356cd7743b5 tempest-VolumesSnapshotsTestJSON-1270646143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:16 devstack sudo[95006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc Jun 04 06:32:16 devstack sudo[95006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:16 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9bdaa617-c1e6-4056-814e-3920134ce9d5 1073741824" returned: 0 in 1.282s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9bdaa617-c1e6-4056-814e-3920134ce9d5 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:16 devstack sudo[95010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9bdaa617-c1e6-4056-814e-3920134ce9d5 Jun 04 06:32:16 devstack sudo[95010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:17 devstack sudo[95006]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-f4fe3236-abc8-499f-8e62-3cf9a1f0663e req-83ab66aa-2d9c-45f0-9448-7356cd7743b5 tempest-VolumesSnapshotsTestJSON-1270646143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc" returned: 0 in 1.147s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-f4fe3236-abc8-499f-8e62-3cf9a1f0663e req-83ab66aa-2d9c-45f0-9448-7356cd7743b5 tempest-VolumesSnapshotsTestJSON-1270646143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:17 devstack sudo[95016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc Jun 04 06:32:17 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:17 devstack sudo[95010]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9bdaa617-c1e6-4056-814e-3920134ce9d5" returned: 0 in 0.828s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:17 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] <== create_volume: return (2169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:32:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.175s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:32:17 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5149b87-c1da-4df2-9a06-1b1c4e12c3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bdaa617-c1e6-4056-814e-3920134ce9d5', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:17 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acb47a3c-4196-4eb2-89a3-104b3ae5fabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:17 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] Volume volume-9bdaa617-c1e6-4056-814e-3920134ce9d5 (9bdaa617-c1e6-4056-814e-3920134ce9d5): created successfully Jun 04 06:32:17 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acb47a3c-4196-4eb2-89a3-104b3ae5fabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:17 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] Flow 'volume_create_manager' (678d4191-4f55-4c56-bb0b-e8fb3fdbf96d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:32:17 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-e9b77a12-3812-4a54-9b45-97d396a944ac tempest-TestServerVolumeAttachmentScenario-549008027 None] Created volume successfully. Jun 04 06:32:18 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-f4fe3236-abc8-499f-8e62-3cf9a1f0663e req-83ab66aa-2d9c-45f0-9448-7356cd7743b5 tempest-VolumesSnapshotsTestJSON-1270646143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ccdc474f-64fc-4da8-8cf7-9d611e5637fc" returned: 0 in 0.833s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:18 devstack cinder-volume[86069]: DEBUG cinder.coordination [req-f4fe3236-abc8-499f-8e62-3cf9a1f0663e req-83ab66aa-2d9c-45f0-9448-7356cd7743b5 tempest-VolumesSnapshotsTestJSON-1270646143 None] Lock "cinder-quobyte-ccdc474f-64fc-4da8-8cf7-9d611e5637fc" released by "delete_volume" :: held 2.097s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:32:18 devstack cinder-volume[86069]: DEBUG cinder.quota [req-f4fe3236-abc8-499f-8e62-3cf9a1f0663e req-83ab66aa-2d9c-45f0-9448-7356cd7743b5 tempest-VolumesSnapshotsTestJSON-1270646143 None] Created reservations ['2c25dc3c-a43c-4a9a-a2dd-07db89538923', '6b18fd03-83b5-4e4f-b94d-530303535203', '56ecdea8-c9f1-40af-90d4-3d0a2d0e35ae', '6abf219f-d0b5-4829-859e-011ed18b106c'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:32:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-f4fe3236-abc8-499f-8e62-3cf9a1f0663e req-83ab66aa-2d9c-45f0-9448-7356cd7743b5 tempest-VolumesSnapshotsTestJSON-1270646143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:32:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-f4fe3236-abc8-499f-8e62-3cf9a1f0663e req-83ab66aa-2d9c-45f0-9448-7356cd7743b5 tempest-VolumesSnapshotsTestJSON-1270646143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:32:18 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [req-f4fe3236-abc8-499f-8e62-3cf9a1f0663e req-83ab66aa-2d9c-45f0-9448-7356cd7743b5 tempest-VolumesSnapshotsTestJSON-1270646143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:32:18 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [req-f4fe3236-abc8-499f-8e62-3cf9a1f0663e req-83ab66aa-2d9c-45f0-9448-7356cd7743b5 tempest-VolumesSnapshotsTestJSON-1270646143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:32:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-f4fe3236-abc8-499f-8e62-3cf9a1f0663e req-83ab66aa-2d9c-45f0-9448-7356cd7743b5 tempest-VolumesSnapshotsTestJSON-1270646143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:32:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-f4fe3236-abc8-499f-8e62-3cf9a1f0663e req-83ab66aa-2d9c-45f0-9448-7356cd7743b5 tempest-VolumesSnapshotsTestJSON-1270646143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:18 devstack sudo[95054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:32:18 devstack sudo[95054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:19 devstack sudo[95054]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-f4fe3236-abc8-499f-8e62-3cf9a1f0663e req-83ab66aa-2d9c-45f0-9448-7356cd7743b5 tempest-VolumesSnapshotsTestJSON-1270646143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.707s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:19 devstack cinder-volume[86069]: DEBUG cinder.manager [req-f4fe3236-abc8-499f-8e62-3cf9a1f0663e req-83ab66aa-2d9c-45f0-9448-7356cd7743b5 tempest-VolumesSnapshotsTestJSON-1270646143 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:32:19 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-f4fe3236-abc8-499f-8e62-3cf9a1f0663e req-83ab66aa-2d9c-45f0-9448-7356cd7743b5 tempest-VolumesSnapshotsTestJSON-1270646143 None] Deleted volume successfully. Jun 04 06:32:19 devstack cinder-volume[86069]: DEBUG cinder.coordination [req-f4fe3236-abc8-499f-8e62-3cf9a1f0663e req-83ab66aa-2d9c-45f0-9448-7356cd7743b5 tempest-VolumesSnapshotsTestJSON-1270646143 None] Lock "cinder-ccdc474f-64fc-4da8-8cf7-9d611e5637fc-delete_volume" released by "delete_volume" :: held 3.332s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:32:20 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:32:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Flow 'volume_create_manager' (56845055-eba7-432b-bbe3-96e81c30d875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:32:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b97373-fae4-4225-a163-decba03d7296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b97373-fae4-4225-a163-decba03d7296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1950208162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2036e8c-ca55-4828-99ce-a46222bc3a5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='468300263a4e433b9b09101068a27373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:32:20Z,use_quota=True,user_id='cbd071a75198448daaa3ad94c6f59e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(544e0d28-379a-452c-9500-c04959723755),volume_type_id=544e0d28-379a-452c-9500-c04959723755)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e98c0e-990b-4f90-a37f-e23037ddc0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e98c0e-990b-4f90-a37f-e23037ddc0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6627cf34-4e32-4a15-bfe2-dfef53f223d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6627cf34-4e32-4a15-bfe2-dfef53f223d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2036e8c-ca55-4828-99ce-a46222bc3a5a', 'volume_name': 'volume-d2036e8c-ca55-4828-99ce-a46222bc3a5a', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63eaee12-b886-4763-acb0-95f72dd7f552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63eaee12-b886-4763-acb0-95f72dd7f552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f825e195-9a3e-4773-8cd5-b570270e6f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:20 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Volume d2036e8c-ca55-4828-99ce-a46222bc3a5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2036e8c-ca55-4828-99ce-a46222bc3a5a', 'volume_size': 1} Jun 04 06:32:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:32:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:32:20 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1950208162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2036e8c-ca55-4828-99ce-a46222bc3a5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='468300263a4e433b9b09101068a27373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:32:20Z,use_quota=True,user_id='cbd071a75198448daaa3ad94c6f59e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(544e0d28-379a-452c-9500-c04959723755),volume_type_id=544e0d28-379a-452c-9500-c04959723755)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:32:20 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Creating volume d2036e8c-ca55-4828-99ce-a46222bc3a5a {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:32:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:32:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:32:20 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:32:20 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:32:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:32:20 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:32:20 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:32:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d2036e8c-ca55-4828-99ce-a46222bc3a5a 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:20 devstack sudo[95061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d2036e8c-ca55-4828-99ce-a46222bc3a5a 1073741824 Jun 04 06:32:20 devstack sudo[95061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:21 devstack sudo[95061]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d2036e8c-ca55-4828-99ce-a46222bc3a5a 1073741824" returned: 0 in 1.000s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d2036e8c-ca55-4828-99ce-a46222bc3a5a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:21 devstack sudo[95067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d2036e8c-ca55-4828-99ce-a46222bc3a5a Jun 04 06:32:21 devstack sudo[95067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:22 devstack sudo[95067]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d2036e8c-ca55-4828-99ce-a46222bc3a5a" returned: 0 in 0.629s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:22 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:32:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:32:22 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f825e195-9a3e-4773-8cd5-b570270e6f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2036e8c-ca55-4828-99ce-a46222bc3a5a', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:22 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ef8ac0-ff5a-41ec-8975-a72cbe465531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:22 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Volume volume-d2036e8c-ca55-4828-99ce-a46222bc3a5a (d2036e8c-ca55-4828-99ce-a46222bc3a5a): created successfully Jun 04 06:32:22 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ef8ac0-ff5a-41ec-8975-a72cbe465531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:22 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Flow 'volume_create_manager' (56845055-eba7-432b-bbe3-96e81c30d875) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:32:22 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-2e1d153d-925e-4392-b445-67a40afe2b49 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Created volume successfully. Jun 04 06:32:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-2ceb2d85-49c6-4b93-800c-0a246da08eb9 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:32:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-2ceb2d85-49c6-4b93-800c-0a246da08eb9 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:32:22 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-2ceb2d85-49c6-4b93-800c-0a246da08eb9 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:32:22 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-2ceb2d85-49c6-4b93-800c-0a246da08eb9 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:32:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-2ceb2d85-49c6-4b93-800c-0a246da08eb9 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:32:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-2ceb2d85-49c6-4b93-800c-0a246da08eb9 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:22 devstack sudo[95071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:32:22 devstack sudo[95071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:23 devstack sudo[95071]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-2ceb2d85-49c6-4b93-800c-0a246da08eb9 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.676s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:23 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-2ceb2d85-49c6-4b93-800c-0a246da08eb9 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:32:23 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-2ceb2d85-49c6-4b93-800c-0a246da08eb9 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Retype volume completed successfully. Jun 04 06:32:24 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a5a6cb45-2c49-4855-9dac-98f1301a9442 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Acquiring lock "cinder-d2036e8c-ca55-4828-99ce-a46222bc3a5a-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:32:24 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a5a6cb45-2c49-4855-9dac-98f1301a9442 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Lock "cinder-d2036e8c-ca55-4828-99ce-a46222bc3a5a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:32:24 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a5a6cb45-2c49-4855-9dac-98f1301a9442 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Acquiring lock "cinder-quobyte-d2036e8c-ca55-4828-99ce-a46222bc3a5a" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:32:24 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a5a6cb45-2c49-4855-9dac-98f1301a9442 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Lock "cinder-quobyte-d2036e8c-ca55-4828-99ce-a46222bc3a5a" acquired by "delete_volume" :: waited 0.042s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:32:24 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-998c46b5-ca57-4fbd-8976-8c36d9586276 tempest-GroupsV320Test-1389170429 None] Group tempest-GroupsV320Test-Group-93158370: creating Jun 04 06:32:24 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6e8c24-558b-4e59-bd30-c4823bd511d3]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:32:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a5a6cb45-2c49-4855-9dac-98f1301a9442 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d2036e8c-ca55-4828-99ce-a46222bc3a5a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:24 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-998c46b5-ca57-4fbd-8976-8c36d9586276 tempest-GroupsV320Test-1389170429 None] Group tempest-GroupsV320Test-Group-93158370: created successfully Jun 04 06:32:24 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-998c46b5-ca57-4fbd-8976-8c36d9586276 tempest-GroupsV320Test-1389170429 None] Create group completed successfully. Jun 04 06:32:24 devstack sudo[95074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d2036e8c-ca55-4828-99ce-a46222bc3a5a Jun 04 06:32:24 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:25 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a5a6cb45-2c49-4855-9dac-98f1301a9442 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d2036e8c-ca55-4828-99ce-a46222bc3a5a" returned: 0 in 1.123s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a5a6cb45-2c49-4855-9dac-98f1301a9442 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d2036e8c-ca55-4828-99ce-a46222bc3a5a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:25 devstack sudo[95130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d2036e8c-ca55-4828-99ce-a46222bc3a5a Jun 04 06:32:25 devstack sudo[95130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:25 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-2e88848d-726a-4627-b355-983e0bf9e8d8 tempest-ServerActionsTestOtherA-1981488141 None] Acquiring lock "cinder-0b48fe95-fd69-4e4b-8baa-18f7de8c1b11-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:32:25 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-2e88848d-726a-4627-b355-983e0bf9e8d8 tempest-ServerActionsTestOtherA-1981488141 None] Lock "cinder-0b48fe95-fd69-4e4b-8baa-18f7de8c1b11-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:32:25 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-2e88848d-726a-4627-b355-983e0bf9e8d8 tempest-ServerActionsTestOtherA-1981488141 None] Acquiring lock "cinder-quobyte-0b48fe95-fd69-4e4b-8baa-18f7de8c1b11" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:32:25 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-2e88848d-726a-4627-b355-983e0bf9e8d8 tempest-ServerActionsTestOtherA-1981488141 None] Lock "cinder-quobyte-0b48fe95-fd69-4e4b-8baa-18f7de8c1b11" acquired by "delete_volume" :: waited 0.021s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:32:26 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f1745e-68cd-41c8-bcd5-f7c7a6e1ade6]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:32:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-2e88848d-726a-4627-b355-983e0bf9e8d8 tempest-ServerActionsTestOtherA-1981488141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0b48fe95-fd69-4e4b-8baa-18f7de8c1b11 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:26 devstack sudo[95135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0b48fe95-fd69-4e4b-8baa-18f7de8c1b11 Jun 04 06:32:26 devstack sudo[95135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:26 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-eb7282ae-e196-47a4-bc09-a2b2e38c2d42 tempest-GroupsV320Test-1389170429 None] Created reservations ['cac1cd76-c55a-4eed-9fb1-49ee9b767042'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:32:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-eb7282ae-e196-47a4-bc09-a2b2e38c2d42 tempest-GroupsV320Test-1389170429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:32:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-eb7282ae-e196-47a4-bc09-a2b2e38c2d42 tempest-GroupsV320Test-1389170429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:32:26 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-eb7282ae-e196-47a4-bc09-a2b2e38c2d42 tempest-GroupsV320Test-1389170429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:32:26 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-eb7282ae-e196-47a4-bc09-a2b2e38c2d42 tempest-GroupsV320Test-1389170429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:32:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-eb7282ae-e196-47a4-bc09-a2b2e38c2d42 tempest-GroupsV320Test-1389170429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:32:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-eb7282ae-e196-47a4-bc09-a2b2e38c2d42 tempest-GroupsV320Test-1389170429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:26 devstack sudo[95138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:32:26 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:26 devstack sudo[95130]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a5a6cb45-2c49-4855-9dac-98f1301a9442 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d2036e8c-ca55-4828-99ce-a46222bc3a5a" returned: 0 in 0.889s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:26 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a5a6cb45-2c49-4855-9dac-98f1301a9442 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Lock "cinder-quobyte-d2036e8c-ca55-4828-99ce-a46222bc3a5a" released by "delete_volume" :: held 2.113s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:32:26 devstack cinder-volume[86069]: WARNING cinder.quota [None req-a5a6cb45-2c49-4855-9dac-98f1301a9442 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 04 06:32:26 devstack cinder-volume[86069]: WARNING cinder.quota [None req-a5a6cb45-2c49-4855-9dac-98f1301a9442 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 04 06:32:26 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-a5a6cb45-2c49-4855-9dac-98f1301a9442 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Created reservations ['f8c690c9-ec05-47be-b5dc-5ee5d3048e48', '5504da4d-5d3b-4f23-84f0-8ca5e2e906cb', 'e589a307-eef9-4c59-a0dd-2a9c833b174f', '5b11e9d2-8b14-48b4-ab87-0b97ebe490d8'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:32:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a5a6cb45-2c49-4855-9dac-98f1301a9442 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:32:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a5a6cb45-2c49-4855-9dac-98f1301a9442 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:32:26 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a5a6cb45-2c49-4855-9dac-98f1301a9442 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:32:26 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a5a6cb45-2c49-4855-9dac-98f1301a9442 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:32:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a5a6cb45-2c49-4855-9dac-98f1301a9442 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:32:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a5a6cb45-2c49-4855-9dac-98f1301a9442 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:26 devstack sudo[95145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:32:26 devstack sudo[95145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:26 devstack sudo[95135]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-2e88848d-726a-4627-b355-983e0bf9e8d8 tempest-ServerActionsTestOtherA-1981488141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0b48fe95-fd69-4e4b-8baa-18f7de8c1b11" returned: 0 in 0.857s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-2e88848d-726a-4627-b355-983e0bf9e8d8 tempest-ServerActionsTestOtherA-1981488141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0b48fe95-fd69-4e4b-8baa-18f7de8c1b11 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:26 devstack sudo[95147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0b48fe95-fd69-4e4b-8baa-18f7de8c1b11 Jun 04 06:32:26 devstack sudo[95147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:27 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-eb7282ae-e196-47a4-bc09-a2b2e38c2d42 tempest-GroupsV320Test-1389170429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.674s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:27 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-eb7282ae-e196-47a4-bc09-a2b2e38c2d42 tempest-GroupsV320Test-1389170429 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:32:27 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-eb7282ae-e196-47a4-bc09-a2b2e38c2d42 tempest-GroupsV320Test-1389170429 None] Delete group completed successfully. Jun 04 06:32:27 devstack sudo[95145]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a5a6cb45-2c49-4855-9dac-98f1301a9442 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.623s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:27 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-a5a6cb45-2c49-4855-9dac-98f1301a9442 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:32:27 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-a5a6cb45-2c49-4855-9dac-98f1301a9442 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Deleted volume successfully. Jun 04 06:32:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a5a6cb45-2c49-4855-9dac-98f1301a9442 tempest-VolumeRetypeWithoutMigrationTest-1270899244 None] Lock "cinder-d2036e8c-ca55-4828-99ce-a46222bc3a5a-delete_volume" released by "delete_volume" :: held 3.082s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:32:27 devstack sudo[95147]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-2e88848d-726a-4627-b355-983e0bf9e8d8 tempest-ServerActionsTestOtherA-1981488141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0b48fe95-fd69-4e4b-8baa-18f7de8c1b11" returned: 0 in 0.651s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-2e88848d-726a-4627-b355-983e0bf9e8d8 tempest-ServerActionsTestOtherA-1981488141 None] Lock "cinder-quobyte-0b48fe95-fd69-4e4b-8baa-18f7de8c1b11" released by "delete_volume" :: held 1.552s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:32:27 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-2e88848d-726a-4627-b355-983e0bf9e8d8 tempest-ServerActionsTestOtherA-1981488141 None] Created reservations ['4291b993-afa8-407b-bc12-8a281ac05598', '0e0b9767-dc59-4c32-95a2-ae64459f6a1b', '7856fda8-ad89-47a0-9426-fc36564faf8d', 'bc65c949-d64a-43bc-9f5f-8df1032c8f83'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:32:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-2e88848d-726a-4627-b355-983e0bf9e8d8 tempest-ServerActionsTestOtherA-1981488141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:32:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-2e88848d-726a-4627-b355-983e0bf9e8d8 tempest-ServerActionsTestOtherA-1981488141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:32:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-2e88848d-726a-4627-b355-983e0bf9e8d8 tempest-ServerActionsTestOtherA-1981488141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:32:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-2e88848d-726a-4627-b355-983e0bf9e8d8 tempest-ServerActionsTestOtherA-1981488141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:32:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-2e88848d-726a-4627-b355-983e0bf9e8d8 tempest-ServerActionsTestOtherA-1981488141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:32:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-2e88848d-726a-4627-b355-983e0bf9e8d8 tempest-ServerActionsTestOtherA-1981488141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:27 devstack sudo[95152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:32:27 devstack sudo[95152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:28 devstack sudo[95152]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-2e88848d-726a-4627-b355-983e0bf9e8d8 tempest-ServerActionsTestOtherA-1981488141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.803s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:28 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-2e88848d-726a-4627-b355-983e0bf9e8d8 tempest-ServerActionsTestOtherA-1981488141 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:32:28 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-2e88848d-726a-4627-b355-983e0bf9e8d8 tempest-ServerActionsTestOtherA-1981488141 None] Deleted volume successfully. Jun 04 06:32:28 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-2e88848d-726a-4627-b355-983e0bf9e8d8 tempest-ServerActionsTestOtherA-1981488141 None] Lock "cinder-0b48fe95-fd69-4e4b-8baa-18f7de8c1b11-delete_volume" released by "delete_volume" :: held 2.601s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:32:37 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=39,cinder:UPDATE=41,cinder:INSERT=12,cinder:DELETE=1 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:32:38 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:UPDATE=76,cinder:DELETE=8,cinder:SELECT=71,cinder:INSERT=12 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:32:39 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:32:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] Flow 'volume_create_manager' (7b3c6ba0-51c5-40ae-beb0-f763e8f4497b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:32:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ed09ee9-aaf2-4693-92a1-58f430aba9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ed09ee9-aaf2-4693-92a1-58f430aba9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-116675797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11c4ed1b-b6da-4787-9124-7fee14d2e7a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3662c2f070d147f6adbf0ef5ae31afff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:32:39Z,use_quota=True,user_id='55922a26465b443b9f5a2eb693cd5060',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72869793-76ae-4405-9b80-43ac62f84338),volume_type_id=72869793-76ae-4405-9b80-43ac62f84338)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccc26793-41d4-412b-aedf-6217cdf080cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccc26793-41d4-412b-aedf-6217cdf080cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7910280-c990-4f9a-ab90-1ecf77b4f02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7910280-c990-4f9a-ab90-1ecf77b4f02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11c4ed1b-b6da-4787-9124-7fee14d2e7a9', 'volume_name': 'volume-11c4ed1b-b6da-4787-9124-7fee14d2e7a9', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6329a465-243c-4d83-8498-9870806f9f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6329a465-243c-4d83-8498-9870806f9f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64369505-0400-4a1d-97b8-7182176837cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:39 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] Volume 11c4ed1b-b6da-4787-9124-7fee14d2e7a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11c4ed1b-b6da-4787-9124-7fee14d2e7a9', 'volume_size': 1} Jun 04 06:32:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:32:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:32:39 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-116675797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11c4ed1b-b6da-4787-9124-7fee14d2e7a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3662c2f070d147f6adbf0ef5ae31afff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:32:39Z,use_quota=True,user_id='55922a26465b443b9f5a2eb693cd5060',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72869793-76ae-4405-9b80-43ac62f84338),volume_type_id=72869793-76ae-4405-9b80-43ac62f84338)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:32:39 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] Creating volume 11c4ed1b-b6da-4787-9124-7fee14d2e7a9 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:32:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:32:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:32:39 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:32:39 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:32:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:32:39 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:32:39 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:32:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-11c4ed1b-b6da-4787-9124-7fee14d2e7a9 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:39 devstack sudo[95284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-11c4ed1b-b6da-4787-9124-7fee14d2e7a9 1073741824 Jun 04 06:32:39 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:40 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-11c4ed1b-b6da-4787-9124-7fee14d2e7a9 1073741824" returned: 0 in 1.032s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-11c4ed1b-b6da-4787-9124-7fee14d2e7a9 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:40 devstack sudo[95291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-11c4ed1b-b6da-4787-9124-7fee14d2e7a9 Jun 04 06:32:40 devstack sudo[95291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:41 devstack sudo[95291]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-11c4ed1b-b6da-4787-9124-7fee14d2e7a9" returned: 0 in 0.876s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:41 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] <== create_volume: return (1973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:32:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.978s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:32:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64369505-0400-4a1d-97b8-7182176837cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11c4ed1b-b6da-4787-9124-7fee14d2e7a9', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58cd4901-eca3-495c-97a9-11e17e9dbc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:41 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] Volume volume-11c4ed1b-b6da-4787-9124-7fee14d2e7a9 (11c4ed1b-b6da-4787-9124-7fee14d2e7a9): created successfully Jun 04 06:32:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58cd4901-eca3-495c-97a9-11e17e9dbc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] Flow 'volume_create_manager' (7b3c6ba0-51c5-40ae-beb0-f763e8f4497b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:32:41 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-7dd2b7d2-740c-4109-9d38-530dae08493f tempest-VolumeTypesAccessTest-1168814565 None] Created volume successfully. Jun 04 06:32:42 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6791f265-2700-49c9-8ca8-2a1e8d3b6d92 tempest-VolumeTypesAccessTest-1168814565 None] Acquiring lock "cinder-11c4ed1b-b6da-4787-9124-7fee14d2e7a9-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:32:42 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6791f265-2700-49c9-8ca8-2a1e8d3b6d92 tempest-VolumeTypesAccessTest-1168814565 None] Lock "cinder-11c4ed1b-b6da-4787-9124-7fee14d2e7a9-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:32:42 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6791f265-2700-49c9-8ca8-2a1e8d3b6d92 tempest-VolumeTypesAccessTest-1168814565 None] Acquiring lock "cinder-quobyte-11c4ed1b-b6da-4787-9124-7fee14d2e7a9" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:32:42 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6791f265-2700-49c9-8ca8-2a1e8d3b6d92 tempest-VolumeTypesAccessTest-1168814565 None] Lock "cinder-quobyte-11c4ed1b-b6da-4787-9124-7fee14d2e7a9" acquired by "delete_volume" :: waited 0.015s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:32:42 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f675f5-5c64-4889-ae35-2b085e5b632c]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:32:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6791f265-2700-49c9-8ca8-2a1e8d3b6d92 tempest-VolumeTypesAccessTest-1168814565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-11c4ed1b-b6da-4787-9124-7fee14d2e7a9 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:43 devstack sudo[95294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-11c4ed1b-b6da-4787-9124-7fee14d2e7a9 Jun 04 06:32:43 devstack sudo[95294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:43 devstack sudo[95294]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6791f265-2700-49c9-8ca8-2a1e8d3b6d92 tempest-VolumeTypesAccessTest-1168814565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-11c4ed1b-b6da-4787-9124-7fee14d2e7a9" returned: 0 in 0.964s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6791f265-2700-49c9-8ca8-2a1e8d3b6d92 tempest-VolumeTypesAccessTest-1168814565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-11c4ed1b-b6da-4787-9124-7fee14d2e7a9 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:43 devstack sudo[95300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-11c4ed1b-b6da-4787-9124-7fee14d2e7a9 Jun 04 06:32:43 devstack sudo[95300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:44 devstack sudo[95300]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6791f265-2700-49c9-8ca8-2a1e8d3b6d92 tempest-VolumeTypesAccessTest-1168814565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-11c4ed1b-b6da-4787-9124-7fee14d2e7a9" returned: 0 in 0.897s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:44 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6791f265-2700-49c9-8ca8-2a1e8d3b6d92 tempest-VolumeTypesAccessTest-1168814565 None] Lock "cinder-quobyte-11c4ed1b-b6da-4787-9124-7fee14d2e7a9" released by "delete_volume" :: held 1.917s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:32:44 devstack cinder-volume[86069]: WARNING cinder.quota [None req-6791f265-2700-49c9-8ca8-2a1e8d3b6d92 tempest-VolumeTypesAccessTest-1168814565 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1165914156 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1165914156, it is now deprecated. Please use the default quota class for default quota. Jun 04 06:32:44 devstack cinder-volume[86069]: WARNING cinder.quota [None req-6791f265-2700-49c9-8ca8-2a1e8d3b6d92 tempest-VolumeTypesAccessTest-1168814565 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1165914156 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1165914156, it is now deprecated. Please use the default quota class for default quota. Jun 04 06:32:44 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-6791f265-2700-49c9-8ca8-2a1e8d3b6d92 tempest-VolumeTypesAccessTest-1168814565 None] Created reservations ['071f37de-8629-4a5f-b7ee-7f3864b6e304', '934eced7-983d-4cad-a003-905e0a17607f', '9d1c10cb-015e-4b36-808c-3c2b92d0cff4', 'f35f391c-dd26-4f85-8c76-391c41d7c363'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:32:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-6791f265-2700-49c9-8ca8-2a1e8d3b6d92 tempest-VolumeTypesAccessTest-1168814565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:32:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-6791f265-2700-49c9-8ca8-2a1e8d3b6d92 tempest-VolumeTypesAccessTest-1168814565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:32:45 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-6791f265-2700-49c9-8ca8-2a1e8d3b6d92 tempest-VolumeTypesAccessTest-1168814565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:32:45 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-6791f265-2700-49c9-8ca8-2a1e8d3b6d92 tempest-VolumeTypesAccessTest-1168814565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:32:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-6791f265-2700-49c9-8ca8-2a1e8d3b6d92 tempest-VolumeTypesAccessTest-1168814565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:32:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6791f265-2700-49c9-8ca8-2a1e8d3b6d92 tempest-VolumeTypesAccessTest-1168814565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:45 devstack sudo[95332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:32:45 devstack sudo[95332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:45 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:32:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] Flow 'volume_create_manager' (59cf7661-e37d-42e6-acc4-010a5ea70dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:32:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (433afceb-9cc1-46c9-b39f-b2be5be8418f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (433afceb-9cc1-46c9-b39f-b2be5be8418f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-116907774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec4b535f-b5cd-4bdc-acca-76e2e5c23941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d748afb38044817a0a2df2068cf2c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:32:46Z,use_quota=True,user_id='a6c3343c7f034ade9125108cd4441f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e33466-dcda-43aa-85ea-ecb0b3ad10ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e33466-dcda-43aa-85ea-ecb0b3ad10ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eb3d294-d7ea-4ee7-8989-7d6f8f124b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eb3d294-d7ea-4ee7-8989-7d6f8f124b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec4b535f-b5cd-4bdc-acca-76e2e5c23941', 'volume_name': 'volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6760522f-3fb8-47e0-b7e6-a1437a8d3de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6760522f-3fb8-47e0-b7e6-a1437a8d3de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2f703c8-c7d3-4593-ae2e-ca3e4912a082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:45 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] Volume ec4b535f-b5cd-4bdc-acca-76e2e5c23941: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941', 'volume_size': 1} Jun 04 06:32:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:32:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:32:45 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-116907774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec4b535f-b5cd-4bdc-acca-76e2e5c23941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d748afb38044817a0a2df2068cf2c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:32:46Z,use_quota=True,user_id='a6c3343c7f034ade9125108cd4441f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:32:45 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] Creating volume ec4b535f-b5cd-4bdc-acca-76e2e5c23941 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:32:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:32:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:32:45 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:32:45 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:32:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:32:45 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:32:45 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:32:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:45 devstack sudo[95334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941 1073741824 Jun 04 06:32:45 devstack sudo[95334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:46 devstack sudo[95332]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6791f265-2700-49c9-8ca8-2a1e8d3b6d92 tempest-VolumeTypesAccessTest-1168814565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.015s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:46 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-6791f265-2700-49c9-8ca8-2a1e8d3b6d92 tempest-VolumeTypesAccessTest-1168814565 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:32:46 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-6791f265-2700-49c9-8ca8-2a1e8d3b6d92 tempest-VolumeTypesAccessTest-1168814565 None] Deleted volume successfully. Jun 04 06:32:46 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6791f265-2700-49c9-8ca8-2a1e8d3b6d92 tempest-VolumeTypesAccessTest-1168814565 None] Lock "cinder-11c4ed1b-b6da-4787-9124-7fee14d2e7a9-delete_volume" released by "delete_volume" :: held 3.284s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:32:46 devstack sudo[95334]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941 1073741824" returned: 0 in 0.937s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:46 devstack sudo[95341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941 Jun 04 06:32:46 devstack sudo[95341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:47 devstack sudo[95341]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941" returned: 0 in 0.672s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:47 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:32:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:32:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2f703c8-c7d3-4593-ae2e-ca3e4912a082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bdc8b39-fce8-4609-a650-0a77e99d50b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:32:47 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] Volume volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941 (ec4b535f-b5cd-4bdc-acca-76e2e5c23941): created successfully Jun 04 06:32:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bdc8b39-fce8-4609-a650-0a77e99d50b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:32:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] Flow 'volume_create_manager' (59cf7661-e37d-42e6-acc4-010a5ea70dc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:32:47 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-cf076e76-03ee-4db1-96d0-81dff0374e56 tempest-SnapshotsActionsTest-1916206556 None] Created volume successfully. Jun 04 06:32:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-179e683a-70f4-4a7f-83a1-40fb1519db6d tempest-SnapshotsActionsTest-1916206556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:32:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-179e683a-70f4-4a7f-83a1-40fb1519db6d tempest-SnapshotsActionsTest-1916206556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:32:48 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-179e683a-70f4-4a7f-83a1-40fb1519db6d tempest-SnapshotsActionsTest-1916206556 None] Creating offline snapshot f516ee87-118d-4c82-9ed4-4a079265dc2e of volume ec4b535f-b5cd-4bdc-acca-76e2e5c23941 {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:32:48 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[25073144-7b25-40f0-acd6-e51bf3224662]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:32:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-179e683a-70f4-4a7f-83a1-40fb1519db6d tempest-SnapshotsActionsTest-1916206556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:48 devstack sudo[95344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941 Jun 04 06:32:48 devstack sudo[95344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:48 devstack sudo[95344]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-179e683a-70f4-4a7f-83a1-40fb1519db6d tempest-SnapshotsActionsTest-1916206556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941" returned: 0 in 0.853s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-179e683a-70f4-4a7f-83a1-40fb1519db6d tempest-SnapshotsActionsTest-1916206556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:48 devstack sudo[95349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e 1G Jun 04 06:32:48 devstack sudo[95349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:49 devstack sudo[95349]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-179e683a-70f4-4a7f-83a1-40fb1519db6d tempest-SnapshotsActionsTest-1916206556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e 1G" returned: 0 in 0.859s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-179e683a-70f4-4a7f-83a1-40fb1519db6d tempest-SnapshotsActionsTest-1916206556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:49 devstack sudo[95355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e Jun 04 06:32:49 devstack sudo[95355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:50 devstack sudo[95355]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-179e683a-70f4-4a7f-83a1-40fb1519db6d tempest-SnapshotsActionsTest-1916206556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e" returned: 0 in 0.726s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:50 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-179e683a-70f4-4a7f-83a1-40fb1519db6d tempest-SnapshotsActionsTest-1916206556 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e is being set with open permissions: ugo+rw Jun 04 06:32:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-179e683a-70f4-4a7f-83a1-40fb1519db6d tempest-SnapshotsActionsTest-1916206556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:50 devstack sudo[95360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e Jun 04 06:32:50 devstack sudo[95360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:51 devstack sudo[95360]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-179e683a-70f4-4a7f-83a1-40fb1519db6d tempest-SnapshotsActionsTest-1916206556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e" returned: 0 in 0.697s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-179e683a-70f4-4a7f-83a1-40fb1519db6d tempest-SnapshotsActionsTest-1916206556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:51 devstack sudo[95363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.info Jun 04 06:32:51 devstack sudo[95363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:52 devstack sudo[95363]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-179e683a-70f4-4a7f-83a1-40fb1519db6d tempest-SnapshotsActionsTest-1916206556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.info" returned: 0 in 0.776s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:52 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-179e683a-70f4-4a7f-83a1-40fb1519db6d tempest-SnapshotsActionsTest-1916206556 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.info is being set with open permissions: ugo+rw Jun 04 06:32:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-179e683a-70f4-4a7f-83a1-40fb1519db6d tempest-SnapshotsActionsTest-1916206556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:52 devstack sudo[95367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.info Jun 04 06:32:52 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:53 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-179e683a-70f4-4a7f-83a1-40fb1519db6d tempest-SnapshotsActionsTest-1916206556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.info" returned: 0 in 1.079s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-179e683a-70f4-4a7f-83a1-40fb1519db6d tempest-SnapshotsActionsTest-1916206556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.117s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:32:53 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-179e683a-70f4-4a7f-83a1-40fb1519db6d tempest-SnapshotsActionsTest-1916206556 None] Create snapshot completed successfully Jun 04 06:32:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-39c61a45-7c2f-47e3-9e43-f6c540c37e32 tempest-SnapshotsActionsTest-1916206556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:32:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-39c61a45-7c2f-47e3-9e43-f6c540c37e32 tempest-SnapshotsActionsTest-1916206556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:32:54 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-39c61a45-7c2f-47e3-9e43-f6c540c37e32 tempest-SnapshotsActionsTest-1916206556 None] Creating offline snapshot 11356605-04a4-437f-a57a-db11f13429da of volume ec4b535f-b5cd-4bdc-acca-76e2e5c23941 {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:32:54 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c53936-b239-459f-9f46-8a05c8df463b]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:32:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-39c61a45-7c2f-47e3-9e43-f6c540c37e32 tempest-SnapshotsActionsTest-1916206556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:54 devstack sudo[95370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e Jun 04 06:32:54 devstack sudo[95370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:55 devstack sudo[95370]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-39c61a45-7c2f-47e3-9e43-f6c540c37e32 tempest-SnapshotsActionsTest-1916206556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e" returned: 0 in 0.855s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-39c61a45-7c2f-47e3-9e43-f6c540c37e32 tempest-SnapshotsActionsTest-1916206556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:32:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-39c61a45-7c2f-47e3-9e43-f6c540c37e32 tempest-SnapshotsActionsTest-1916206556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.11356605-04a4-437f-a57a-db11f13429da 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:55 devstack sudo[95377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.11356605-04a4-437f-a57a-db11f13429da 1G Jun 04 06:32:55 devstack sudo[95377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:56 devstack sudo[95377]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-39c61a45-7c2f-47e3-9e43-f6c540c37e32 tempest-SnapshotsActionsTest-1916206556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.11356605-04a4-437f-a57a-db11f13429da 1G" returned: 0 in 0.975s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-39c61a45-7c2f-47e3-9e43-f6c540c37e32 tempest-SnapshotsActionsTest-1916206556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.11356605-04a4-437f-a57a-db11f13429da {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:56 devstack sudo[95382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.11356605-04a4-437f-a57a-db11f13429da Jun 04 06:32:56 devstack sudo[95382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:56 devstack sudo[95382]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-39c61a45-7c2f-47e3-9e43-f6c540c37e32 tempest-SnapshotsActionsTest-1916206556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.11356605-04a4-437f-a57a-db11f13429da" returned: 0 in 0.935s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:56 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-39c61a45-7c2f-47e3-9e43-f6c540c37e32 tempest-SnapshotsActionsTest-1916206556 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.11356605-04a4-437f-a57a-db11f13429da is being set with open permissions: ugo+rw Jun 04 06:32:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-39c61a45-7c2f-47e3-9e43-f6c540c37e32 tempest-SnapshotsActionsTest-1916206556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.11356605-04a4-437f-a57a-db11f13429da {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:57 devstack sudo[95392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.11356605-04a4-437f-a57a-db11f13429da Jun 04 06:32:57 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:57 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-39c61a45-7c2f-47e3-9e43-f6c540c37e32 tempest-SnapshotsActionsTest-1916206556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.11356605-04a4-437f-a57a-db11f13429da" returned: 0 in 0.824s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-39c61a45-7c2f-47e3-9e43-f6c540c37e32 tempest-SnapshotsActionsTest-1916206556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.749s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:32:57 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-39c61a45-7c2f-47e3-9e43-f6c540c37e32 tempest-SnapshotsActionsTest-1916206556 None] Create snapshot completed successfully Jun 04 06:32:58 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-695ffa4b-1ce9-40a2-b518-ac37c53e79ca tempest-SnapshotsActionsTest-26926918 None] Acquiring lock "cinder-11356605-04a4-437f-a57a-db11f13429da-delete_snapshot" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:32:58 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-695ffa4b-1ce9-40a2-b518-ac37c53e79ca tempest-SnapshotsActionsTest-26926918 None] Lock "cinder-11356605-04a4-437f-a57a-db11f13429da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:32:58 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-695ffa4b-1ce9-40a2-b518-ac37c53e79ca tempest-SnapshotsActionsTest-26926918 None] Acquiring lock "cinder-quobyte-ec4b535f-b5cd-4bdc-acca-76e2e5c23941" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:32:58 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-695ffa4b-1ce9-40a2-b518-ac37c53e79ca tempest-SnapshotsActionsTest-26926918 None] Lock "cinder-quobyte-ec4b535f-b5cd-4bdc-acca-76e2e5c23941" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:32:58 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-695ffa4b-1ce9-40a2-b518-ac37c53e79ca tempest-SnapshotsActionsTest-26926918 None] Acquiring lock "cinder-quobyte-11356605-04a4-437f-a57a-db11f13429da" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:32:58 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-695ffa4b-1ce9-40a2-b518-ac37c53e79ca tempest-SnapshotsActionsTest-26926918 None] Lock "cinder-quobyte-11356605-04a4-437f-a57a-db11f13429da" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:32:58 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-695ffa4b-1ce9-40a2-b518-ac37c53e79ca tempest-SnapshotsActionsTest-26926918 None] Deleting offline snapshot 11356605-04a4-437f-a57a-db11f13429da of volume ec4b535f-b5cd-4bdc-acca-76e2e5c23941 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:32:58 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-695ffa4b-1ce9-40a2-b518-ac37c53e79ca tempest-SnapshotsActionsTest-26926918 None] snapshot_file for this snap is: volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.11356605-04a4-437f-a57a-db11f13429da {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:32:58 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[9432ea0d-b34c-4c79-9df2-d8d674e1c040]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:32:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-695ffa4b-1ce9-40a2-b518-ac37c53e79ca tempest-SnapshotsActionsTest-26926918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.11356605-04a4-437f-a57a-db11f13429da {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:58 devstack sudo[95395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.11356605-04a4-437f-a57a-db11f13429da Jun 04 06:32:58 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:32:59 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root Jun 04 06:32:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-695ffa4b-1ce9-40a2-b518-ac37c53e79ca tempest-SnapshotsActionsTest-26926918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.11356605-04a4-437f-a57a-db11f13429da" returned: 0 in 0.939s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:32:59 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-695ffa4b-1ce9-40a2-b518-ac37c53e79ca tempest-SnapshotsActionsTest-26926918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:32:59 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[4daf84f6-557e-4b47-b629-a42e53314e5e]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:32:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-695ffa4b-1ce9-40a2-b518-ac37c53e79ca tempest-SnapshotsActionsTest-26926918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:32:59 devstack sudo[95400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e Jun 04 06:32:59 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:00 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-695ffa4b-1ce9-40a2-b518-ac37c53e79ca tempest-SnapshotsActionsTest-26926918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e" returned: 0 in 0.847s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:00 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-695ffa4b-1ce9-40a2-b518-ac37c53e79ca tempest-SnapshotsActionsTest-26926918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:33:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-695ffa4b-1ce9-40a2-b518-ac37c53e79ca tempest-SnapshotsActionsTest-26926918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.11356605-04a4-437f-a57a-db11f13429da {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:00 devstack sudo[95405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.11356605-04a4-437f-a57a-db11f13429da Jun 04 06:33:00 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-ca54e504-2027-4b65-a0df-b6efe0a73049 req-19a95233-a13f-4747-9763-179558fbd777 tempest-TestServerVolumeAttachmentScenario-549008027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:33:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-ca54e504-2027-4b65-a0df-b6efe0a73049 req-19a95233-a13f-4747-9763-179558fbd777 tempest-TestServerVolumeAttachmentScenario-549008027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:33:01 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[975263f4-d70f-4c97-8ec5-425fe98c910d]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:33:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-ca54e504-2027-4b65-a0df-b6efe0a73049 req-19a95233-a13f-4747-9763-179558fbd777 tempest-TestServerVolumeAttachmentScenario-549008027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-451cfba6-d340-4967-bb50-350d97344a2a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:01 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-695ffa4b-1ce9-40a2-b518-ac37c53e79ca tempest-SnapshotsActionsTest-26926918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.11356605-04a4-437f-a57a-db11f13429da" returned: 0 in 0.911s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-695ffa4b-1ce9-40a2-b518-ac37c53e79ca tempest-SnapshotsActionsTest-26926918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.11356605-04a4-437f-a57a-db11f13429da {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:01 devstack sudo[95420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.11356605-04a4-437f-a57a-db11f13429da Jun 04 06:33:01 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:01 devstack sudo[95419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-451cfba6-d340-4967-bb50-350d97344a2a Jun 04 06:33:01 devstack sudo[95419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:02 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-695ffa4b-1ce9-40a2-b518-ac37c53e79ca tempest-SnapshotsActionsTest-26926918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.11356605-04a4-437f-a57a-db11f13429da" returned: 0 in 0.710s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:02 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-695ffa4b-1ce9-40a2-b518-ac37c53e79ca tempest-SnapshotsActionsTest-26926918 None] Lock "cinder-quobyte-11356605-04a4-437f-a57a-db11f13429da" released by "_delete_snapshot" :: held 3.562s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:33:02 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-695ffa4b-1ce9-40a2-b518-ac37c53e79ca tempest-SnapshotsActionsTest-26926918 None] Lock "cinder-quobyte-ec4b535f-b5cd-4bdc-acca-76e2e5c23941" released by "delete_snapshot" :: held 3.595s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:33:02 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-695ffa4b-1ce9-40a2-b518-ac37c53e79ca tempest-SnapshotsActionsTest-26926918 None] Created reservations ['9dcef251-421a-4a1e-ab4d-5930df1e08da', '7a080865-0d04-4657-b616-59b1983910ba', 'cd8644d9-9ad3-4e98-b4b5-6ec19669fe5d', '06eae97f-cf91-424c-a1f8-331e17bc6b48'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:33:02 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-695ffa4b-1ce9-40a2-b518-ac37c53e79ca tempest-SnapshotsActionsTest-26926918 None] Delete snapshot completed successfully. Jun 04 06:33:02 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-695ffa4b-1ce9-40a2-b518-ac37c53e79ca tempest-SnapshotsActionsTest-26926918 None] Lock "cinder-11356605-04a4-437f-a57a-db11f13429da-delete_snapshot" released by "delete_snapshot" :: held 3.803s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:33:02 devstack sudo[95419]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-ca54e504-2027-4b65-a0df-b6efe0a73049 req-19a95233-a13f-4747-9763-179558fbd777 tempest-TestServerVolumeAttachmentScenario-549008027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-451cfba6-d340-4967-bb50-350d97344a2a" returned: 0 in 1.019s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-ca54e504-2027-4b65-a0df-b6efe0a73049 req-19a95233-a13f-4747-9763-179558fbd777 tempest-TestServerVolumeAttachmentScenario-549008027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.043s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:33:02 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-ca54e504-2027-4b65-a0df-b6efe0a73049 req-19a95233-a13f-4747-9763-179558fbd777 tempest-TestServerVolumeAttachmentScenario-549008027 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574', 'name': 'volume-451cfba6-d340-4967-bb50-350d97344a2a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a8a578bf-7802-45e7-9950-86c930b66805', 'enforce_multipath': True} {{(pid=86069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 06:33:02 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-ca54e504-2027-4b65-a0df-b6efe0a73049 req-19a95233-a13f-4747-9763-179558fbd777 tempest-TestServerVolumeAttachmentScenario-549008027 None] attachment_update completed successfully. Jun 04 06:33:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-30768635-9866-4ca3-a1e2-109e60254e93 tempest-SnapshotsActionsTest-1916206556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:33:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-30768635-9866-4ca3-a1e2-109e60254e93 tempest-SnapshotsActionsTest-1916206556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:33:03 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-30768635-9866-4ca3-a1e2-109e60254e93 tempest-SnapshotsActionsTest-1916206556 None] Creating offline snapshot 7e21bc88-9052-4ea3-994a-7b9f3cca3e97 of volume ec4b535f-b5cd-4bdc-acca-76e2e5c23941 {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:33:03 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3973a5-265f-4d58-8f5c-b2a9cfb0f9e3]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:33:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-30768635-9866-4ca3-a1e2-109e60254e93 tempest-SnapshotsActionsTest-1916206556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:03 devstack sudo[95497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e Jun 04 06:33:03 devstack sudo[95497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:04 devstack sudo[95497]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-30768635-9866-4ca3-a1e2-109e60254e93 tempest-SnapshotsActionsTest-1916206556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e" returned: 0 in 0.950s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:04 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-30768635-9866-4ca3-a1e2-109e60254e93 tempest-SnapshotsActionsTest-1916206556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:33:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-30768635-9866-4ca3-a1e2-109e60254e93 tempest-SnapshotsActionsTest-1916206556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.7e21bc88-9052-4ea3-994a-7b9f3cca3e97 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:04 devstack sudo[95819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.7e21bc88-9052-4ea3-994a-7b9f3cca3e97 1G Jun 04 06:33:04 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:05 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-30768635-9866-4ca3-a1e2-109e60254e93 tempest-SnapshotsActionsTest-1916206556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.7e21bc88-9052-4ea3-994a-7b9f3cca3e97 1G" returned: 0 in 1.080s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-30768635-9866-4ca3-a1e2-109e60254e93 tempest-SnapshotsActionsTest-1916206556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.7e21bc88-9052-4ea3-994a-7b9f3cca3e97 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:05 devstack sudo[95825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.7e21bc88-9052-4ea3-994a-7b9f3cca3e97 Jun 04 06:33:05 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:06 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-30768635-9866-4ca3-a1e2-109e60254e93 tempest-SnapshotsActionsTest-1916206556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.7e21bc88-9052-4ea3-994a-7b9f3cca3e97" returned: 0 in 0.741s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:06 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-30768635-9866-4ca3-a1e2-109e60254e93 tempest-SnapshotsActionsTest-1916206556 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.7e21bc88-9052-4ea3-994a-7b9f3cca3e97 is being set with open permissions: ugo+rw Jun 04 06:33:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-30768635-9866-4ca3-a1e2-109e60254e93 tempest-SnapshotsActionsTest-1916206556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.7e21bc88-9052-4ea3-994a-7b9f3cca3e97 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:06 devstack sudo[95830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.7e21bc88-9052-4ea3-994a-7b9f3cca3e97 Jun 04 06:33:06 devstack sudo[95830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:07 devstack sudo[95830]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-30768635-9866-4ca3-a1e2-109e60254e93 tempest-SnapshotsActionsTest-1916206556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.7e21bc88-9052-4ea3-994a-7b9f3cca3e97" returned: 0 in 0.715s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-30768635-9866-4ca3-a1e2-109e60254e93 tempest-SnapshotsActionsTest-1916206556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.659s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:33:07 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-30768635-9866-4ca3-a1e2-109e60254e93 tempest-SnapshotsActionsTest-1916206556 None] Create snapshot completed successfully Jun 04 06:33:07 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:33:07 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] Flow 'volume_create_manager' (b7dbfe68-176a-4764-9726-a2bee5350fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:33:07 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3aeeb95-4a79-473c-aea7-83232f211dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:07 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4fce8240-9d1b-4af7-80e5-332b85c94a66 tempest-SnapshotsActionsTest-26926918 None] Acquiring lock "cinder-7e21bc88-9052-4ea3-994a-7b9f3cca3e97-delete_snapshot" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:33:07 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3aeeb95-4a79-473c-aea7-83232f211dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-789423803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed20c8b-72d3-4dff-a0a4-a706988a5a9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0806538157c4f5bb06b64ec155a3bb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:33:08Z,use_quota=True,user_id='13bce94118844a17b18926ad1b4fb2c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:07 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa827e16-c570-4cad-9128-2a2aa7df2e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:07 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa827e16-c570-4cad-9128-2a2aa7df2e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:07 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (536626c1-ec30-429f-af19-a169a5eb11f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:07 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (536626c1-ec30-429f-af19-a169a5eb11f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ed20c8b-72d3-4dff-a0a4-a706988a5a9f', 'volume_name': 'volume-9ed20c8b-72d3-4dff-a0a4-a706988a5a9f', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:07 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c46e4094-a3ec-4447-87fd-fa5b20b932e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:07 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c46e4094-a3ec-4447-87fd-fa5b20b932e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:07 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85cd229a-ce99-4c01-b553-cc40947e8180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:07 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] Volume 9ed20c8b-72d3-4dff-a0a4-a706988a5a9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ed20c8b-72d3-4dff-a0a4-a706988a5a9f', 'volume_size': 1} Jun 04 06:33:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:33:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:33:07 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-789423803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed20c8b-72d3-4dff-a0a4-a706988a5a9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0806538157c4f5bb06b64ec155a3bb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:33:08Z,use_quota=True,user_id='13bce94118844a17b18926ad1b4fb2c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:33:07 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] Creating volume 9ed20c8b-72d3-4dff-a0a4-a706988a5a9f {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:33:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:33:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:33:07 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:33:07 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:33:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:33:07 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:33:07 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:33:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9ed20c8b-72d3-4dff-a0a4-a706988a5a9f 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:07 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4fce8240-9d1b-4af7-80e5-332b85c94a66 tempest-SnapshotsActionsTest-26926918 None] Lock "cinder-7e21bc88-9052-4ea3-994a-7b9f3cca3e97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.113s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:33:07 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4fce8240-9d1b-4af7-80e5-332b85c94a66 tempest-SnapshotsActionsTest-26926918 None] Acquiring lock "cinder-quobyte-ec4b535f-b5cd-4bdc-acca-76e2e5c23941" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:33:07 devstack sudo[95835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9ed20c8b-72d3-4dff-a0a4-a706988a5a9f 1073741824 Jun 04 06:33:07 devstack sudo[95835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:07 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4fce8240-9d1b-4af7-80e5-332b85c94a66 tempest-SnapshotsActionsTest-26926918 None] Lock "cinder-quobyte-ec4b535f-b5cd-4bdc-acca-76e2e5c23941" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:33:07 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4fce8240-9d1b-4af7-80e5-332b85c94a66 tempest-SnapshotsActionsTest-26926918 None] Acquiring lock "cinder-quobyte-7e21bc88-9052-4ea3-994a-7b9f3cca3e97" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:33:07 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4fce8240-9d1b-4af7-80e5-332b85c94a66 tempest-SnapshotsActionsTest-26926918 None] Lock "cinder-quobyte-7e21bc88-9052-4ea3-994a-7b9f3cca3e97" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:33:07 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-4fce8240-9d1b-4af7-80e5-332b85c94a66 tempest-SnapshotsActionsTest-26926918 None] Deleting offline snapshot 7e21bc88-9052-4ea3-994a-7b9f3cca3e97 of volume ec4b535f-b5cd-4bdc-acca-76e2e5c23941 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:33:07 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-4fce8240-9d1b-4af7-80e5-332b85c94a66 tempest-SnapshotsActionsTest-26926918 None] snapshot_file for this snap is: volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.7e21bc88-9052-4ea3-994a-7b9f3cca3e97 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:33:07 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbd6838-7432-4ce7-82b6-6d21a08721b2]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:33:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4fce8240-9d1b-4af7-80e5-332b85c94a66 tempest-SnapshotsActionsTest-26926918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.7e21bc88-9052-4ea3-994a-7b9f3cca3e97 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:08 devstack sudo[95838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.7e21bc88-9052-4ea3-994a-7b9f3cca3e97 Jun 04 06:33:08 devstack sudo[95838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:09 devstack sudo[95838]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4fce8240-9d1b-4af7-80e5-332b85c94a66 tempest-SnapshotsActionsTest-26926918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.7e21bc88-9052-4ea3-994a-7b9f3cca3e97" returned: 0 in 1.244s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:09 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-4fce8240-9d1b-4af7-80e5-332b85c94a66 tempest-SnapshotsActionsTest-26926918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:33:09 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af15ec9-bf86-4830-b7e0-f4788aba0335]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:33:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4fce8240-9d1b-4af7-80e5-332b85c94a66 tempest-SnapshotsActionsTest-26926918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:09 devstack sudo[95835]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9ed20c8b-72d3-4dff-a0a4-a706988a5a9f 1073741824" returned: 0 in 1.541s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9ed20c8b-72d3-4dff-a0a4-a706988a5a9f {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:09 devstack sudo[95853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e Jun 04 06:33:09 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:09 devstack sudo[95856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9ed20c8b-72d3-4dff-a0a4-a706988a5a9f Jun 04 06:33:09 devstack sudo[95856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9ed20c8b-72d3-4dff-a0a4-a706988a5a9f" returned: 0 in 0.957s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:10 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] <== create_volume: return (2570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:33:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.574s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:33:10 devstack sudo[95856]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85cd229a-ce99-4c01-b553-cc40947e8180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ed20c8b-72d3-4dff-a0a4-a706988a5a9f', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7483129b-7809-4dec-854f-01f6276cd5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:10 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] Volume volume-9ed20c8b-72d3-4dff-a0a4-a706988a5a9f (9ed20c8b-72d3-4dff-a0a4-a706988a5a9f): created successfully Jun 04 06:33:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7483129b-7809-4dec-854f-01f6276cd5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] Flow 'volume_create_manager' (b7dbfe68-176a-4764-9726-a2bee5350fd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:33:10 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-a8097303-787c-4240-a7c4-dfcbf591f308 tempest-VolumesListAdminTestJSON-2078268913 None] Created volume successfully. Jun 04 06:33:10 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4fce8240-9d1b-4af7-80e5-332b85c94a66 tempest-SnapshotsActionsTest-26926918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e" returned: 0 in 1.497s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:10 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-4fce8240-9d1b-4af7-80e5-332b85c94a66 tempest-SnapshotsActionsTest-26926918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:33:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4fce8240-9d1b-4af7-80e5-332b85c94a66 tempest-SnapshotsActionsTest-26926918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.7e21bc88-9052-4ea3-994a-7b9f3cca3e97 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:10 devstack sudo[95879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.7e21bc88-9052-4ea3-994a-7b9f3cca3e97 Jun 04 06:33:10 devstack sudo[95879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:33:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:33:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:33:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:33:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:33:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:33:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:11 devstack sudo[95881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:33:11 devstack sudo[95881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:11 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:33:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] Flow 'volume_create_manager' (7fe3639c-489d-457f-bcfa-ef2b8581603b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:33:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b70f432-8f49-49bf-a11e-3954e49b2f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b70f432-8f49-49bf-a11e-3954e49b2f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-427206316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5e29eb-8ffc-4304-9815-e755355751c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0806538157c4f5bb06b64ec155a3bb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:33:12Z,use_quota=True,user_id='13bce94118844a17b18926ad1b4fb2c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a8aa6fd-da18-430d-875e-e91b69401d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a8aa6fd-da18-430d-875e-e91b69401d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a3e6d95-14be-4e1c-b6f5-fbe3251074fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a3e6d95-14be-4e1c-b6f5-fbe3251074fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef5e29eb-8ffc-4304-9815-e755355751c4', 'volume_name': 'volume-ef5e29eb-8ffc-4304-9815-e755355751c4', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e0a76ef-b8f1-4f00-bcfb-7a94ced3a21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e0a76ef-b8f1-4f00-bcfb-7a94ced3a21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2111506a-3302-434a-b235-cdb3e5783aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:12 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] Volume ef5e29eb-8ffc-4304-9815-e755355751c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef5e29eb-8ffc-4304-9815-e755355751c4', 'volume_size': 1} Jun 04 06:33:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:33:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:33:12 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-427206316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5e29eb-8ffc-4304-9815-e755355751c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0806538157c4f5bb06b64ec155a3bb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:33:12Z,use_quota=True,user_id='13bce94118844a17b18926ad1b4fb2c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:33:12 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] Creating volume ef5e29eb-8ffc-4304-9815-e755355751c4 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:33:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:33:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:33:12 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:33:12 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:33:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:33:12 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:33:12 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:33:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ef5e29eb-8ffc-4304-9815-e755355751c4 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:12 devstack sudo[95892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ef5e29eb-8ffc-4304-9815-e755355751c4 1073741824 Jun 04 06:33:12 devstack sudo[95892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4fce8240-9d1b-4af7-80e5-332b85c94a66 tempest-SnapshotsActionsTest-26926918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.7e21bc88-9052-4ea3-994a-7b9f3cca3e97" returned: 0 in 1.456s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4fce8240-9d1b-4af7-80e5-332b85c94a66 tempest-SnapshotsActionsTest-26926918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.7e21bc88-9052-4ea3-994a-7b9f3cca3e97 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:12 devstack sudo[95879]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:12 devstack sudo[95894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.7e21bc88-9052-4ea3-994a-7b9f3cca3e97 Jun 04 06:33:12 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:12 devstack sudo[95881]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.231s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:12 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:33:12 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager._thread_info {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:33:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread count: 28 {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 06:33:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread info: [<_MainThread(MainThread, started 131797370544256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 06:33:13 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4fce8240-9d1b-4af7-80e5-332b85c94a66 tempest-SnapshotsActionsTest-26926918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.7e21bc88-9052-4ea3-994a-7b9f3cca3e97" returned: 0 in 1.020s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:13 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4fce8240-9d1b-4af7-80e5-332b85c94a66 tempest-SnapshotsActionsTest-26926918 None] Lock "cinder-quobyte-7e21bc88-9052-4ea3-994a-7b9f3cca3e97" released by "_delete_snapshot" :: held 5.387s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:33:13 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4fce8240-9d1b-4af7-80e5-332b85c94a66 tempest-SnapshotsActionsTest-26926918 None] Lock "cinder-quobyte-ec4b535f-b5cd-4bdc-acca-76e2e5c23941" released by "delete_snapshot" :: held 5.421s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:33:13 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-4fce8240-9d1b-4af7-80e5-332b85c94a66 tempest-SnapshotsActionsTest-26926918 None] Created reservations ['74533925-088d-4e45-8ead-cebc6fc9fed8', 'e6a5e6e0-7317-4319-b1c2-bb974fb9f4a8', '4ba92bb1-13c7-4294-afa1-19304442b2a6', 'ee6c9f9e-25eb-41ce-b26f-3059882bcbcd'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:33:13 devstack sudo[95892]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ef5e29eb-8ffc-4304-9815-e755355751c4 1073741824" returned: 0 in 1.293s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:13 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-4fce8240-9d1b-4af7-80e5-332b85c94a66 tempest-SnapshotsActionsTest-26926918 None] Delete snapshot completed successfully. Jun 04 06:33:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ef5e29eb-8ffc-4304-9815-e755355751c4 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:13 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4fce8240-9d1b-4af7-80e5-332b85c94a66 tempest-SnapshotsActionsTest-26926918 None] Lock "cinder-7e21bc88-9052-4ea3-994a-7b9f3cca3e97-delete_snapshot" released by "delete_snapshot" :: held 5.643s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:33:13 devstack sudo[95914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ef5e29eb-8ffc-4304-9815-e755355751c4 Jun 04 06:33:13 devstack sudo[95914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:14 devstack sudo[95914]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ef5e29eb-8ffc-4304-9815-e755355751c4" returned: 0 in 0.669s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:14 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] <== create_volume: return (2033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:33:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.036s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:33:14 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2111506a-3302-434a-b235-cdb3e5783aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef5e29eb-8ffc-4304-9815-e755355751c4', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:14 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96c7d841-c53a-47d9-b445-255fb1c8c976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:14 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] Volume volume-ef5e29eb-8ffc-4304-9815-e755355751c4 (ef5e29eb-8ffc-4304-9815-e755355751c4): created successfully Jun 04 06:33:14 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96c7d841-c53a-47d9-b445-255fb1c8c976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:14 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] Flow 'volume_create_manager' (7fe3639c-489d-457f-bcfa-ef2b8581603b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:33:14 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-bdd00e29-43c1-4ea7-8334-eb6150bad578 tempest-VolumesListAdminTestJSON-2078268913 None] Created volume successfully. Jun 04 06:33:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-468d321a-dfa0-4a88-a860-54cdd54c48ec tempest-SnapshotsActionsTest-1916206556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:33:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-468d321a-dfa0-4a88-a860-54cdd54c48ec tempest-SnapshotsActionsTest-1916206556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:33:14 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-468d321a-dfa0-4a88-a860-54cdd54c48ec tempest-SnapshotsActionsTest-1916206556 None] Creating offline snapshot 21338000-2494-4500-b3d1-a04929b384c8 of volume ec4b535f-b5cd-4bdc-acca-76e2e5c23941 {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:33:14 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[894bd33b-0296-4b25-80fe-42bef816a3bf]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:33:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-468d321a-dfa0-4a88-a860-54cdd54c48ec tempest-SnapshotsActionsTest-1916206556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:14 devstack sudo[95918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e Jun 04 06:33:14 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:15 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-468d321a-dfa0-4a88-a860-54cdd54c48ec tempest-SnapshotsActionsTest-1916206556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e" returned: 0 in 0.854s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:15 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-468d321a-dfa0-4a88-a860-54cdd54c48ec tempest-SnapshotsActionsTest-1916206556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:33:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-468d321a-dfa0-4a88-a860-54cdd54c48ec tempest-SnapshotsActionsTest-1916206556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.21338000-2494-4500-b3d1-a04929b384c8 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:15 devstack sudo[95927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.21338000-2494-4500-b3d1-a04929b384c8 1G Jun 04 06:33:15 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:15 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:33:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] Flow 'volume_create_manager' (ca902058-9684-4f41-94c5-d1f8c18ffbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:33:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3964ca1f-54ed-4c72-8aac-930eee22d485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3964ca1f-54ed-4c72-8aac-930eee22d485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1882065670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21b38cdd-d129-4b37-a919-1a8bf717733a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0806538157c4f5bb06b64ec155a3bb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:33:16Z,use_quota=True,user_id='13bce94118844a17b18926ad1b4fb2c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d70ab817-93e9-4b72-b319-751cf5e3254f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d70ab817-93e9-4b72-b319-751cf5e3254f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5662734b-fa40-49b3-8b87-6be4075431ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5662734b-fa40-49b3-8b87-6be4075431ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21b38cdd-d129-4b37-a919-1a8bf717733a', 'volume_name': 'volume-21b38cdd-d129-4b37-a919-1a8bf717733a', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f28ac446-c618-4e11-b87e-0562a0a7b91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f28ac446-c618-4e11-b87e-0562a0a7b91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc3595f-d4a0-46d5-b305-e70a5dde1371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:15 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] Volume 21b38cdd-d129-4b37-a919-1a8bf717733a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21b38cdd-d129-4b37-a919-1a8bf717733a', 'volume_size': 1} Jun 04 06:33:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:33:16 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-9adcc404-3c86-46fb-8120-d658660bc39d req-b66b260a-d18f-4f03-8e18-212445e33ec3 tempest-TestServerVolumeAttachmentScenario-549008027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:33:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-468d321a-dfa0-4a88-a860-54cdd54c48ec tempest-SnapshotsActionsTest-1916206556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.21338000-2494-4500-b3d1-a04929b384c8 1G" returned: 0 in 0.852s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-468d321a-dfa0-4a88-a860-54cdd54c48ec tempest-SnapshotsActionsTest-1916206556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.21338000-2494-4500-b3d1-a04929b384c8 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:16 devstack sudo[95940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.21338000-2494-4500-b3d1-a04929b384c8 Jun 04 06:33:16 devstack sudo[95940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:17 devstack sudo[95940]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-468d321a-dfa0-4a88-a860-54cdd54c48ec tempest-SnapshotsActionsTest-1916206556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.21338000-2494-4500-b3d1-a04929b384c8" returned: 0 in 1.133s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:17 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-468d321a-dfa0-4a88-a860-54cdd54c48ec tempest-SnapshotsActionsTest-1916206556 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.21338000-2494-4500-b3d1-a04929b384c8 is being set with open permissions: ugo+rw Jun 04 06:33:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-468d321a-dfa0-4a88-a860-54cdd54c48ec tempest-SnapshotsActionsTest-1916206556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.21338000-2494-4500-b3d1-a04929b384c8 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:17 devstack sudo[96013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.21338000-2494-4500-b3d1-a04929b384c8 Jun 04 06:33:17 devstack sudo[96013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:18 devstack sudo[96013]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-468d321a-dfa0-4a88-a860-54cdd54c48ec tempest-SnapshotsActionsTest-1916206556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.21338000-2494-4500-b3d1-a04929b384c8" returned: 0 in 0.619s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-468d321a-dfa0-4a88-a860-54cdd54c48ec tempest-SnapshotsActionsTest-1916206556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.564s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:33:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.413s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:33:18 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1882065670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21b38cdd-d129-4b37-a919-1a8bf717733a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0806538157c4f5bb06b64ec155a3bb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:33:16Z,use_quota=True,user_id='13bce94118844a17b18926ad1b4fb2c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:33:18 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] Creating volume 21b38cdd-d129-4b37-a919-1a8bf717733a {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:33:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:33:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:33:18 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:33:18 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:33:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:33:18 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:33:18 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:33:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-21b38cdd-d129-4b37-a919-1a8bf717733a 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:18 devstack sudo[96017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-21b38cdd-d129-4b37-a919-1a8bf717733a 1073741824 Jun 04 06:33:18 devstack sudo[96017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:18 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-468d321a-dfa0-4a88-a860-54cdd54c48ec tempest-SnapshotsActionsTest-1916206556 None] Create snapshot completed successfully Jun 04 06:33:19 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c4bb5436-b73e-4eb7-ad43-b17c03545178 tempest-SnapshotsActionsTest-26926918 None] Acquiring lock "cinder-21338000-2494-4500-b3d1-a04929b384c8-delete_snapshot" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:33:19 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c4bb5436-b73e-4eb7-ad43-b17c03545178 tempest-SnapshotsActionsTest-26926918 None] Lock "cinder-21338000-2494-4500-b3d1-a04929b384c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:33:19 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c4bb5436-b73e-4eb7-ad43-b17c03545178 tempest-SnapshotsActionsTest-26926918 None] Acquiring lock "cinder-quobyte-ec4b535f-b5cd-4bdc-acca-76e2e5c23941" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:33:19 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c4bb5436-b73e-4eb7-ad43-b17c03545178 tempest-SnapshotsActionsTest-26926918 None] Lock "cinder-quobyte-ec4b535f-b5cd-4bdc-acca-76e2e5c23941" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:33:19 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c4bb5436-b73e-4eb7-ad43-b17c03545178 tempest-SnapshotsActionsTest-26926918 None] Acquiring lock "cinder-quobyte-21338000-2494-4500-b3d1-a04929b384c8" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:33:19 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c4bb5436-b73e-4eb7-ad43-b17c03545178 tempest-SnapshotsActionsTest-26926918 None] Lock "cinder-quobyte-21338000-2494-4500-b3d1-a04929b384c8" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:33:19 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-c4bb5436-b73e-4eb7-ad43-b17c03545178 tempest-SnapshotsActionsTest-26926918 None] Deleting offline snapshot 21338000-2494-4500-b3d1-a04929b384c8 of volume ec4b535f-b5cd-4bdc-acca-76e2e5c23941 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:33:19 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-c4bb5436-b73e-4eb7-ad43-b17c03545178 tempest-SnapshotsActionsTest-26926918 None] snapshot_file for this snap is: volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.21338000-2494-4500-b3d1-a04929b384c8 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:33:19 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0700a0-51b6-4652-9414-0d23a20dadeb]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:33:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c4bb5436-b73e-4eb7-ad43-b17c03545178 tempest-SnapshotsActionsTest-26926918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.21338000-2494-4500-b3d1-a04929b384c8 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:19 devstack sudo[96017]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-21b38cdd-d129-4b37-a919-1a8bf717733a 1073741824" returned: 0 in 1.674s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-21b38cdd-d129-4b37-a919-1a8bf717733a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:19 devstack sudo[96058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.21338000-2494-4500-b3d1-a04929b384c8 Jun 04 06:33:19 devstack sudo[96058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:19 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-21b38cdd-d129-4b37-a919-1a8bf717733a Jun 04 06:33:20 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:20 devstack sudo[96058]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c4bb5436-b73e-4eb7-ad43-b17c03545178 tempest-SnapshotsActionsTest-26926918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.21338000-2494-4500-b3d1-a04929b384c8" returned: 0 in 1.187s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:20 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-c4bb5436-b73e-4eb7-ad43-b17c03545178 tempest-SnapshotsActionsTest-26926918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:33:20 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[66184308-34cd-45f3-85a0-1651dda95c2f]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:33:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c4bb5436-b73e-4eb7-ad43-b17c03545178 tempest-SnapshotsActionsTest-26926918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:21 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-21b38cdd-d129-4b37-a919-1a8bf717733a" returned: 0 in 1.068s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:21 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] <== create_volume: return (2851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:33:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.855s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:33:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-9adcc404-3c86-46fb-8120-d658660bc39d req-b66b260a-d18f-4f03-8e18-212445e33ec3 tempest-TestServerVolumeAttachmentScenario-549008027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.657s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:33:21 devstack sudo[96068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e Jun 04 06:33:21 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:21 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc3595f-d4a0-46d5-b305-e70a5dde1371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21b38cdd-d129-4b37-a919-1a8bf717733a', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:21 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f812a6-2942-41b7-8089-9e3bfe3e5600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:21 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[462675f0-c1dd-4b62-8952-619b3b057af0]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:33:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-9adcc404-3c86-46fb-8120-d658660bc39d req-b66b260a-d18f-4f03-8e18-212445e33ec3 tempest-TestServerVolumeAttachmentScenario-549008027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9bdaa617-c1e6-4056-814e-3920134ce9d5 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:21 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] Volume volume-21b38cdd-d129-4b37-a919-1a8bf717733a (21b38cdd-d129-4b37-a919-1a8bf717733a): created successfully Jun 04 06:33:21 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f812a6-2942-41b7-8089-9e3bfe3e5600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:21 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] Flow 'volume_create_manager' (ca902058-9684-4f41-94c5-d1f8c18ffbf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:33:21 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-13a4872a-ef16-4742-be59-b52cabae68b9 tempest-VolumesListAdminTestJSON-2078268913 None] Created volume successfully. Jun 04 06:33:21 devstack sudo[96070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9bdaa617-c1e6-4056-814e-3920134ce9d5 Jun 04 06:33:21 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:21 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c4bb5436-b73e-4eb7-ad43-b17c03545178 tempest-SnapshotsActionsTest-26926918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e" returned: 0 in 0.955s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:21 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-c4bb5436-b73e-4eb7-ad43-b17c03545178 tempest-SnapshotsActionsTest-26926918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:33:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c4bb5436-b73e-4eb7-ad43-b17c03545178 tempest-SnapshotsActionsTest-26926918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.21338000-2494-4500-b3d1-a04929b384c8 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:21 devstack sudo[96077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.21338000-2494-4500-b3d1-a04929b384c8 Jun 04 06:33:21 devstack sudo[96077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:22 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-9adcc404-3c86-46fb-8120-d658660bc39d req-b66b260a-d18f-4f03-8e18-212445e33ec3 tempest-TestServerVolumeAttachmentScenario-549008027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9bdaa617-c1e6-4056-814e-3920134ce9d5" returned: 0 in 1.205s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-9adcc404-3c86-46fb-8120-d658660bc39d req-b66b260a-d18f-4f03-8e18-212445e33ec3 tempest-TestServerVolumeAttachmentScenario-549008027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.269s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:33:22 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-9adcc404-3c86-46fb-8120-d658660bc39d req-b66b260a-d18f-4f03-8e18-212445e33ec3 tempest-TestServerVolumeAttachmentScenario-549008027 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574', 'name': 'volume-9bdaa617-c1e6-4056-814e-3920134ce9d5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '23c72232-6058-4a2e-a271-ef27e15f9906', 'enforce_multipath': True} {{(pid=86069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 06:33:22 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-9adcc404-3c86-46fb-8120-d658660bc39d req-b66b260a-d18f-4f03-8e18-212445e33ec3 tempest-TestServerVolumeAttachmentScenario-549008027 None] attachment_update completed successfully. Jun 04 06:33:23 devstack sudo[96077]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c4bb5436-b73e-4eb7-ad43-b17c03545178 tempest-SnapshotsActionsTest-26926918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.21338000-2494-4500-b3d1-a04929b384c8" returned: 0 in 1.615s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c4bb5436-b73e-4eb7-ad43-b17c03545178 tempest-SnapshotsActionsTest-26926918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.21338000-2494-4500-b3d1-a04929b384c8 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:23 devstack sudo[96111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.21338000-2494-4500-b3d1-a04929b384c8 Jun 04 06:33:23 devstack sudo[96111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:23 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:33:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] Flow 'volume_create_manager' (05d79f19-43a9-4f35-a9fe-483832b81931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:33:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a9c2a2-ccf3-4fb6-816a-601397f86525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a9c2a2-ccf3-4fb6-816a-601397f86525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=678eb5f9-0569-45c8-a814-dc08b04aa00a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='172a7e32db3e457aba19b8c678153264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:33:23Z,use_quota=True,user_id='68c04b51cbde401494eb5ceea15cf160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cfb14d7-7520-4957-bbe7-c11ef0c96748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cfb14d7-7520-4957-bbe7-c11ef0c96748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c2c3b77-c751-4f01-a8a7-aa6abc7e6648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c2c3b77-c751-4f01-a8a7-aa6abc7e6648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '678eb5f9-0569-45c8-a814-dc08b04aa00a', 'volume_name': 'volume-678eb5f9-0569-45c8-a814-dc08b04aa00a', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ace9fb-ddcd-46e2-bbd5-e01d2efc5c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ace9fb-ddcd-46e2-bbd5-e01d2efc5c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a712349a-2ea8-4167-9581-a9059448f1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:23 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] Volume 678eb5f9-0569-45c8-a814-dc08b04aa00a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-678eb5f9-0569-45c8-a814-dc08b04aa00a', 'volume_size': 1} Jun 04 06:33:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:33:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:33:23 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=678eb5f9-0569-45c8-a814-dc08b04aa00a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='172a7e32db3e457aba19b8c678153264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:33:23Z,use_quota=True,user_id='68c04b51cbde401494eb5ceea15cf160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:33:23 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] Creating volume 678eb5f9-0569-45c8-a814-dc08b04aa00a {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:33:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:33:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:33:23 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:33:23 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:33:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:33:23 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:33:23 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:33:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-678eb5f9-0569-45c8-a814-dc08b04aa00a 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:23 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-678eb5f9-0569-45c8-a814-dc08b04aa00a 1073741824 Jun 04 06:33:23 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:24 devstack sudo[96111]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c4bb5436-b73e-4eb7-ad43-b17c03545178 tempest-SnapshotsActionsTest-26926918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.21338000-2494-4500-b3d1-a04929b384c8" returned: 0 in 1.040s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:24 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c4bb5436-b73e-4eb7-ad43-b17c03545178 tempest-SnapshotsActionsTest-26926918 None] Lock "cinder-quobyte-21338000-2494-4500-b3d1-a04929b384c8" released by "_delete_snapshot" :: held 4.980s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:33:24 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c4bb5436-b73e-4eb7-ad43-b17c03545178 tempest-SnapshotsActionsTest-26926918 None] Lock "cinder-quobyte-ec4b535f-b5cd-4bdc-acca-76e2e5c23941" released by "delete_snapshot" :: held 5.038s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:33:24 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-c4bb5436-b73e-4eb7-ad43-b17c03545178 tempest-SnapshotsActionsTest-26926918 None] Created reservations ['466ce228-bb1f-401b-8d18-ea644db9563d', 'b3125c1a-93de-407c-9c05-c4dfe38e17be', 'ff194a42-b533-4b88-8078-a983907aef4b', '095d5a8b-c416-4277-859c-3f1e2c7547db'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:33:24 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-c4bb5436-b73e-4eb7-ad43-b17c03545178 tempest-SnapshotsActionsTest-26926918 None] Delete snapshot completed successfully. Jun 04 06:33:24 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c4bb5436-b73e-4eb7-ad43-b17c03545178 tempest-SnapshotsActionsTest-26926918 None] Lock "cinder-21338000-2494-4500-b3d1-a04929b384c8-delete_snapshot" released by "delete_snapshot" :: held 5.325s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:33:25 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-678eb5f9-0569-45c8-a814-dc08b04aa00a 1073741824" returned: 0 in 1.340s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-678eb5f9-0569-45c8-a814-dc08b04aa00a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:25 devstack sudo[96124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-678eb5f9-0569-45c8-a814-dc08b04aa00a Jun 04 06:33:25 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c875427b-ec5a-43c6-8306-c21c8568f8e1 tempest-SnapshotsActionsTest-1916206556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:33:26 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-678eb5f9-0569-45c8-a814-dc08b04aa00a" returned: 0 in 1.190s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:26 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] <== create_volume: return (2614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:33:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.620s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:33:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c875427b-ec5a-43c6-8306-c21c8568f8e1 tempest-SnapshotsActionsTest-1916206556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.235s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:33:26 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-c875427b-ec5a-43c6-8306-c21c8568f8e1 tempest-SnapshotsActionsTest-1916206556 None] Creating offline snapshot dae00a3d-1400-4596-9f64-051a8f6cb8ff of volume ec4b535f-b5cd-4bdc-acca-76e2e5c23941 {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:33:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a712349a-2ea8-4167-9581-a9059448f1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-678eb5f9-0569-45c8-a814-dc08b04aa00a', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb943052-16e6-4f75-b964-ec2cd20db0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:26 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a04697-f082-4db8-8147-c45dcc3a91f1]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:33:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c875427b-ec5a-43c6-8306-c21c8568f8e1 tempest-SnapshotsActionsTest-1916206556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:26 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] Volume volume-678eb5f9-0569-45c8-a814-dc08b04aa00a (678eb5f9-0569-45c8-a814-dc08b04aa00a): created successfully Jun 04 06:33:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb943052-16e6-4f75-b964-ec2cd20db0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] Flow 'volume_create_manager' (05d79f19-43a9-4f35-a9fe-483832b81931) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:33:26 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-36f62790-dbe2-4cb1-8764-2621f6819be1 tempest-VolumesListAdminTestJSON-162279525 None] Created volume successfully. Jun 04 06:33:26 devstack sudo[96164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e Jun 04 06:33:26 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-e171670f-32d9-4887-9556-8f76e0ce9fb2 tempest-VolumesListAdminTestJSON-162279525 None] Acquiring lock "cinder-678eb5f9-0569-45c8-a814-dc08b04aa00a-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:33:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-e171670f-32d9-4887-9556-8f76e0ce9fb2 tempest-VolumesListAdminTestJSON-162279525 None] Lock "cinder-678eb5f9-0569-45c8-a814-dc08b04aa00a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:33:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-e171670f-32d9-4887-9556-8f76e0ce9fb2 tempest-VolumesListAdminTestJSON-162279525 None] Acquiring lock "cinder-quobyte-678eb5f9-0569-45c8-a814-dc08b04aa00a" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:33:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-e171670f-32d9-4887-9556-8f76e0ce9fb2 tempest-VolumesListAdminTestJSON-162279525 None] Lock "cinder-quobyte-678eb5f9-0569-45c8-a814-dc08b04aa00a" acquired by "delete_volume" :: waited 0.030s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:33:27 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd1fcc3-9fda-400a-83f6-105c75cc24fe]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:33:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e171670f-32d9-4887-9556-8f76e0ce9fb2 tempest-VolumesListAdminTestJSON-162279525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-678eb5f9-0569-45c8-a814-dc08b04aa00a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9c5e2f46-f7a2-4f75-96ee-f821d4602db7 tempest-VolumesListAdminTestJSON-2078268913 None] Acquiring lock "cinder-21b38cdd-d129-4b37-a919-1a8bf717733a-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:33:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9c5e2f46-f7a2-4f75-96ee-f821d4602db7 tempest-VolumesListAdminTestJSON-2078268913 None] Lock "cinder-21b38cdd-d129-4b37-a919-1a8bf717733a-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:33:27 devstack sudo[96166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-678eb5f9-0569-45c8-a814-dc08b04aa00a Jun 04 06:33:27 devstack sudo[96166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9c5e2f46-f7a2-4f75-96ee-f821d4602db7 tempest-VolumesListAdminTestJSON-2078268913 None] Acquiring lock "cinder-quobyte-21b38cdd-d129-4b37-a919-1a8bf717733a" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:33:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9c5e2f46-f7a2-4f75-96ee-f821d4602db7 tempest-VolumesListAdminTestJSON-2078268913 None] Lock "cinder-quobyte-21b38cdd-d129-4b37-a919-1a8bf717733a" acquired by "delete_volume" :: waited 0.078s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:33:27 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae7fc03-c789-4288-b652-046a0f2a033c]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:33:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9c5e2f46-f7a2-4f75-96ee-f821d4602db7 tempest-VolumesListAdminTestJSON-2078268913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-21b38cdd-d129-4b37-a919-1a8bf717733a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:28 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c875427b-ec5a-43c6-8306-c21c8568f8e1 tempest-SnapshotsActionsTest-1916206556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e" returned: 0 in 1.533s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:28 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-c875427b-ec5a-43c6-8306-c21c8568f8e1 tempest-SnapshotsActionsTest-1916206556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:33:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c875427b-ec5a-43c6-8306-c21c8568f8e1 tempest-SnapshotsActionsTest-1916206556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.dae00a3d-1400-4596-9f64-051a8f6cb8ff 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:28 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-21b38cdd-d129-4b37-a919-1a8bf717733a Jun 04 06:33:28 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:28 devstack sudo[96197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.dae00a3d-1400-4596-9f64-051a8f6cb8ff 1G Jun 04 06:33:28 devstack sudo[96197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:29 devstack sudo[96166]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e171670f-32d9-4887-9556-8f76e0ce9fb2 tempest-VolumesListAdminTestJSON-162279525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-678eb5f9-0569-45c8-a814-dc08b04aa00a" returned: 0 in 1.934s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e171670f-32d9-4887-9556-8f76e0ce9fb2 tempest-VolumesListAdminTestJSON-162279525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-678eb5f9-0569-45c8-a814-dc08b04aa00a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:29 devstack sudo[96217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-678eb5f9-0569-45c8-a814-dc08b04aa00a Jun 04 06:33:29 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:29 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9c5e2f46-f7a2-4f75-96ee-f821d4602db7 tempest-VolumesListAdminTestJSON-2078268913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-21b38cdd-d129-4b37-a919-1a8bf717733a" returned: 0 in 1.636s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9c5e2f46-f7a2-4f75-96ee-f821d4602db7 tempest-VolumesListAdminTestJSON-2078268913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-21b38cdd-d129-4b37-a919-1a8bf717733a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:29 devstack sudo[96226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-21b38cdd-d129-4b37-a919-1a8bf717733a Jun 04 06:33:29 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:29 devstack sudo[96197]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c875427b-ec5a-43c6-8306-c21c8568f8e1 tempest-SnapshotsActionsTest-1916206556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.dae00a3d-1400-4596-9f64-051a8f6cb8ff 1G" returned: 0 in 1.855s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c875427b-ec5a-43c6-8306-c21c8568f8e1 tempest-SnapshotsActionsTest-1916206556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.dae00a3d-1400-4596-9f64-051a8f6cb8ff {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:29 devstack sudo[96230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.dae00a3d-1400-4596-9f64-051a8f6cb8ff Jun 04 06:33:29 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:30 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9c5e2f46-f7a2-4f75-96ee-f821d4602db7 tempest-VolumesListAdminTestJSON-2078268913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-21b38cdd-d129-4b37-a919-1a8bf717733a" returned: 0 in 0.680s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:30 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9c5e2f46-f7a2-4f75-96ee-f821d4602db7 tempest-VolumesListAdminTestJSON-2078268913 None] Lock "cinder-quobyte-21b38cdd-d129-4b37-a919-1a8bf717733a" released by "delete_volume" :: held 2.444s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:33:30 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-9c5e2f46-f7a2-4f75-96ee-f821d4602db7 tempest-VolumesListAdminTestJSON-2078268913 None] Created reservations ['1cc5485e-b84f-4f63-9cd8-f24c6dc07060', '6c275a9d-e738-4e19-85bf-641c879ffec6', '57f06b89-2613-4f6c-b7d6-bcfa45bba38c', '614b9f1b-a56e-4351-ae84-34eca0da2d2a'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:33:30 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e171670f-32d9-4887-9556-8f76e0ce9fb2 tempest-VolumesListAdminTestJSON-162279525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-678eb5f9-0569-45c8-a814-dc08b04aa00a" returned: 0 in 0.984s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:30 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-e171670f-32d9-4887-9556-8f76e0ce9fb2 tempest-VolumesListAdminTestJSON-162279525 None] Lock "cinder-quobyte-678eb5f9-0569-45c8-a814-dc08b04aa00a" released by "delete_volume" :: held 3.016s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:33:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9c5e2f46-f7a2-4f75-96ee-f821d4602db7 tempest-VolumesListAdminTestJSON-2078268913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:33:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9c5e2f46-f7a2-4f75-96ee-f821d4602db7 tempest-VolumesListAdminTestJSON-2078268913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:33:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-9c5e2f46-f7a2-4f75-96ee-f821d4602db7 tempest-VolumesListAdminTestJSON-2078268913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:33:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-9c5e2f46-f7a2-4f75-96ee-f821d4602db7 tempest-VolumesListAdminTestJSON-2078268913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:33:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9c5e2f46-f7a2-4f75-96ee-f821d4602db7 tempest-VolumesListAdminTestJSON-2078268913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:33:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9c5e2f46-f7a2-4f75-96ee-f821d4602db7 tempest-VolumesListAdminTestJSON-2078268913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:30 devstack sudo[96234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:33:30 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:30 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-e171670f-32d9-4887-9556-8f76e0ce9fb2 tempest-VolumesListAdminTestJSON-162279525 None] Created reservations ['e90424fb-7e87-476e-bc91-35926f33afc3', 'd27c6b87-80cd-4681-b806-a413585f4ac1', '071e053d-c292-4d6d-9eaf-1b6be34cc489', '56d84efa-61c5-499a-93dc-87e9dfcc5cf5'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:33:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e171670f-32d9-4887-9556-8f76e0ce9fb2 tempest-VolumesListAdminTestJSON-162279525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:33:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e171670f-32d9-4887-9556-8f76e0ce9fb2 tempest-VolumesListAdminTestJSON-162279525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:33:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e171670f-32d9-4887-9556-8f76e0ce9fb2 tempest-VolumesListAdminTestJSON-162279525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:33:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e171670f-32d9-4887-9556-8f76e0ce9fb2 tempest-VolumesListAdminTestJSON-162279525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:33:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e171670f-32d9-4887-9556-8f76e0ce9fb2 tempest-VolumesListAdminTestJSON-162279525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:33:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e171670f-32d9-4887-9556-8f76e0ce9fb2 tempest-VolumesListAdminTestJSON-162279525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:30 devstack sudo[96238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:33:30 devstack sudo[96238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:30 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-37570b7b-279e-470e-9bdb-3eb7926a09ac req-a1c0cd4f-d6fc-4919-94b2-1ee5cd0b0654 tempest-TestServerVolumeAttachmentScenario-549008027 None] Terminate volume connection completed successfully. Jun 04 06:33:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-37570b7b-279e-470e-9bdb-3eb7926a09ac req-a1c0cd4f-d6fc-4919-94b2-1ee5cd0b0654 tempest-TestServerVolumeAttachmentScenario-549008027 None] Deleting attachment 23c72232-6058-4a2e-a271-ef27e15f9906. {{(pid=86069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 06:33:31 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c875427b-ec5a-43c6-8306-c21c8568f8e1 tempest-SnapshotsActionsTest-1916206556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.dae00a3d-1400-4596-9f64-051a8f6cb8ff" returned: 0 in 1.267s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:31 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-c875427b-ec5a-43c6-8306-c21c8568f8e1 tempest-SnapshotsActionsTest-1916206556 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.dae00a3d-1400-4596-9f64-051a8f6cb8ff is being set with open permissions: ugo+rw Jun 04 06:33:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c875427b-ec5a-43c6-8306-c21c8568f8e1 tempest-SnapshotsActionsTest-1916206556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.dae00a3d-1400-4596-9f64-051a8f6cb8ff {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:31 devstack sudo[96243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.dae00a3d-1400-4596-9f64-051a8f6cb8ff Jun 04 06:33:31 devstack sudo[96243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:31 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-e5518656-e295-4531-aff3-6ee9c72fd273 tempest-VolumesListAdminTestJSON-2078268913 None] Acquiring lock "cinder-ef5e29eb-8ffc-4304-9815-e755355751c4-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:33:31 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-e5518656-e295-4531-aff3-6ee9c72fd273 tempest-VolumesListAdminTestJSON-2078268913 None] Lock "cinder-ef5e29eb-8ffc-4304-9815-e755355751c4-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:33:31 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-e5518656-e295-4531-aff3-6ee9c72fd273 tempest-VolumesListAdminTestJSON-2078268913 None] Acquiring lock "cinder-quobyte-ef5e29eb-8ffc-4304-9815-e755355751c4" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:33:31 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-e5518656-e295-4531-aff3-6ee9c72fd273 tempest-VolumesListAdminTestJSON-2078268913 None] Lock "cinder-quobyte-ef5e29eb-8ffc-4304-9815-e755355751c4" acquired by "delete_volume" :: waited 0.025s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:33:31 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8517bd6-8fb6-42df-9ec3-cf479addf762]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:33:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e5518656-e295-4531-aff3-6ee9c72fd273 tempest-VolumesListAdminTestJSON-2078268913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ef5e29eb-8ffc-4304-9815-e755355751c4 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:31 devstack sudo[96238]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e171670f-32d9-4887-9556-8f76e0ce9fb2 tempest-VolumesListAdminTestJSON-162279525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.046s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:31 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-e171670f-32d9-4887-9556-8f76e0ce9fb2 tempest-VolumesListAdminTestJSON-162279525 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:33:31 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-e171670f-32d9-4887-9556-8f76e0ce9fb2 tempest-VolumesListAdminTestJSON-162279525 None] Deleted volume successfully. Jun 04 06:33:31 devstack sudo[96254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ef5e29eb-8ffc-4304-9815-e755355751c4 Jun 04 06:33:31 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-e171670f-32d9-4887-9556-8f76e0ce9fb2 tempest-VolumesListAdminTestJSON-162279525 None] Lock "cinder-678eb5f9-0569-45c8-a814-dc08b04aa00a-delete_volume" released by "delete_volume" :: held 4.592s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:33:31 devstack sudo[96254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:31 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9c5e2f46-f7a2-4f75-96ee-f821d4602db7 tempest-VolumesListAdminTestJSON-2078268913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.444s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:31 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-9c5e2f46-f7a2-4f75-96ee-f821d4602db7 tempest-VolumesListAdminTestJSON-2078268913 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:33:31 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-9c5e2f46-f7a2-4f75-96ee-f821d4602db7 tempest-VolumesListAdminTestJSON-2078268913 None] Deleted volume successfully. Jun 04 06:33:31 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9c5e2f46-f7a2-4f75-96ee-f821d4602db7 tempest-VolumesListAdminTestJSON-2078268913 None] Lock "cinder-21b38cdd-d129-4b37-a919-1a8bf717733a-delete_volume" released by "delete_volume" :: held 4.363s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:33:32 devstack sudo[96243]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c875427b-ec5a-43c6-8306-c21c8568f8e1 tempest-SnapshotsActionsTest-1916206556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.dae00a3d-1400-4596-9f64-051a8f6cb8ff" returned: 0 in 0.978s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c875427b-ec5a-43c6-8306-c21c8568f8e1 tempest-SnapshotsActionsTest-1916206556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.762s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:33:32 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-c875427b-ec5a-43c6-8306-c21c8568f8e1 tempest-SnapshotsActionsTest-1916206556 None] Create snapshot completed successfully Jun 04 06:33:32 devstack sudo[96254]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e5518656-e295-4531-aff3-6ee9c72fd273 tempest-VolumesListAdminTestJSON-2078268913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ef5e29eb-8ffc-4304-9815-e755355751c4" returned: 0 in 0.932s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e5518656-e295-4531-aff3-6ee9c72fd273 tempest-VolumesListAdminTestJSON-2078268913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ef5e29eb-8ffc-4304-9815-e755355751c4 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:32 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ef5e29eb-8ffc-4304-9815-e755355751c4 Jun 04 06:33:32 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:32 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-537f7865-f1f2-4f39-b860-f9695cb085f1 tempest-SnapshotsActionsTest-26926918 None] Acquiring lock "cinder-dae00a3d-1400-4596-9f64-051a8f6cb8ff-delete_snapshot" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:33:32 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-537f7865-f1f2-4f39-b860-f9695cb085f1 tempest-SnapshotsActionsTest-26926918 None] Lock "cinder-dae00a3d-1400-4596-9f64-051a8f6cb8ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:33:32 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-537f7865-f1f2-4f39-b860-f9695cb085f1 tempest-SnapshotsActionsTest-26926918 None] Acquiring lock "cinder-quobyte-ec4b535f-b5cd-4bdc-acca-76e2e5c23941" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:33:32 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-537f7865-f1f2-4f39-b860-f9695cb085f1 tempest-SnapshotsActionsTest-26926918 None] Lock "cinder-quobyte-ec4b535f-b5cd-4bdc-acca-76e2e5c23941" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:33:32 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-537f7865-f1f2-4f39-b860-f9695cb085f1 tempest-SnapshotsActionsTest-26926918 None] Acquiring lock "cinder-quobyte-dae00a3d-1400-4596-9f64-051a8f6cb8ff" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:33:32 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-537f7865-f1f2-4f39-b860-f9695cb085f1 tempest-SnapshotsActionsTest-26926918 None] Lock "cinder-quobyte-dae00a3d-1400-4596-9f64-051a8f6cb8ff" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:33:32 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-537f7865-f1f2-4f39-b860-f9695cb085f1 tempest-SnapshotsActionsTest-26926918 None] Deleting offline snapshot dae00a3d-1400-4596-9f64-051a8f6cb8ff of volume ec4b535f-b5cd-4bdc-acca-76e2e5c23941 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:33:32 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-537f7865-f1f2-4f39-b860-f9695cb085f1 tempest-SnapshotsActionsTest-26926918 None] snapshot_file for this snap is: volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.dae00a3d-1400-4596-9f64-051a8f6cb8ff {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:33:32 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c291f2-73f9-4f68-80d9-b4db51a14bee]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:33:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-537f7865-f1f2-4f39-b860-f9695cb085f1 tempest-SnapshotsActionsTest-26926918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.dae00a3d-1400-4596-9f64-051a8f6cb8ff {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:33 devstack sudo[96282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.dae00a3d-1400-4596-9f64-051a8f6cb8ff Jun 04 06:33:33 devstack sudo[96282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:33 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e5518656-e295-4531-aff3-6ee9c72fd273 tempest-VolumesListAdminTestJSON-2078268913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ef5e29eb-8ffc-4304-9815-e755355751c4" returned: 0 in 0.670s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-e5518656-e295-4531-aff3-6ee9c72fd273 tempest-VolumesListAdminTestJSON-2078268913 None] Lock "cinder-quobyte-ef5e29eb-8ffc-4304-9815-e755355751c4" released by "delete_volume" :: held 1.649s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:33:33 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-e5518656-e295-4531-aff3-6ee9c72fd273 tempest-VolumesListAdminTestJSON-2078268913 None] Created reservations ['009dd630-b821-43a0-b38f-d32ba549260e', 'bd538d64-82df-4a51-b58b-435c513d9bd5', '444d00d6-4364-406e-bd61-a7b594b9b3ea', '35430ac9-3f58-4357-b7e1-3d908aa2b8b7'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:33:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e5518656-e295-4531-aff3-6ee9c72fd273 tempest-VolumesListAdminTestJSON-2078268913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:33:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e5518656-e295-4531-aff3-6ee9c72fd273 tempest-VolumesListAdminTestJSON-2078268913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:33:33 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e5518656-e295-4531-aff3-6ee9c72fd273 tempest-VolumesListAdminTestJSON-2078268913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:33:33 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e5518656-e295-4531-aff3-6ee9c72fd273 tempest-VolumesListAdminTestJSON-2078268913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:33:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e5518656-e295-4531-aff3-6ee9c72fd273 tempest-VolumesListAdminTestJSON-2078268913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:33:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e5518656-e295-4531-aff3-6ee9c72fd273 tempest-VolumesListAdminTestJSON-2078268913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:33 devstack sudo[96285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:33:33 devstack sudo[96285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1879c2cb-ff55-4b69-bf8d-d7e105629fa4 tempest-VolumesListAdminTestJSON-2078268913 None] Acquiring lock "cinder-9ed20c8b-72d3-4dff-a0a4-a706988a5a9f-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:33:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1879c2cb-ff55-4b69-bf8d-d7e105629fa4 tempest-VolumesListAdminTestJSON-2078268913 None] Lock "cinder-9ed20c8b-72d3-4dff-a0a4-a706988a5a9f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:33:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1879c2cb-ff55-4b69-bf8d-d7e105629fa4 tempest-VolumesListAdminTestJSON-2078268913 None] Acquiring lock "cinder-quobyte-9ed20c8b-72d3-4dff-a0a4-a706988a5a9f" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:33:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1879c2cb-ff55-4b69-bf8d-d7e105629fa4 tempest-VolumesListAdminTestJSON-2078268913 None] Lock "cinder-quobyte-9ed20c8b-72d3-4dff-a0a4-a706988a5a9f" acquired by "delete_volume" :: waited 0.024s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:33:34 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[199fa7f7-8f12-438a-ae29-6793b99f0634]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:33:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1879c2cb-ff55-4b69-bf8d-d7e105629fa4 tempest-VolumesListAdminTestJSON-2078268913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9ed20c8b-72d3-4dff-a0a4-a706988a5a9f {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:34 devstack sudo[96282]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-537f7865-f1f2-4f39-b860-f9695cb085f1 tempest-SnapshotsActionsTest-26926918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.dae00a3d-1400-4596-9f64-051a8f6cb8ff" returned: 0 in 1.527s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-537f7865-f1f2-4f39-b860-f9695cb085f1 tempest-SnapshotsActionsTest-26926918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:33:34 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[748ffe46-10f4-45aa-9f04-e1b7e8149bc7]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:33:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-537f7865-f1f2-4f39-b860-f9695cb085f1 tempest-SnapshotsActionsTest-26926918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:34 devstack sudo[96285]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:34 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9ed20c8b-72d3-4dff-a0a4-a706988a5a9f Jun 04 06:33:34 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e5518656-e295-4531-aff3-6ee9c72fd273 tempest-VolumesListAdminTestJSON-2078268913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.184s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:34 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-e5518656-e295-4531-aff3-6ee9c72fd273 tempest-VolumesListAdminTestJSON-2078268913 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:33:34 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-e5518656-e295-4531-aff3-6ee9c72fd273 tempest-VolumesListAdminTestJSON-2078268913 None] Deleted volume successfully. Jun 04 06:33:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-e5518656-e295-4531-aff3-6ee9c72fd273 tempest-VolumesListAdminTestJSON-2078268913 None] Lock "cinder-ef5e29eb-8ffc-4304-9815-e755355751c4-delete_volume" released by "delete_volume" :: held 3.257s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:33:34 devstack sudo[96336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e Jun 04 06:33:34 devstack sudo[96336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:34 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-5773e6a9-500b-4af3-bfdf-9e0397eaea1d req-4c5910b4-8e6d-4483-a717-ecd93c86f2be tempest-TestServerVolumeAttachmentScenario-549008027 None] Terminate volume connection completed successfully. Jun 04 06:33:34 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-5773e6a9-500b-4af3-bfdf-9e0397eaea1d req-4c5910b4-8e6d-4483-a717-ecd93c86f2be tempest-TestServerVolumeAttachmentScenario-549008027 None] Deleting attachment a8a578bf-7802-45e7-9950-86c930b66805. {{(pid=86069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 06:33:35 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1879c2cb-ff55-4b69-bf8d-d7e105629fa4 tempest-VolumesListAdminTestJSON-2078268913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9ed20c8b-72d3-4dff-a0a4-a706988a5a9f" returned: 0 in 1.037s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1879c2cb-ff55-4b69-bf8d-d7e105629fa4 tempest-VolumesListAdminTestJSON-2078268913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9ed20c8b-72d3-4dff-a0a4-a706988a5a9f {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:35 devstack sudo[96349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9ed20c8b-72d3-4dff-a0a4-a706988a5a9f Jun 04 06:33:35 devstack sudo[96349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:35 devstack sudo[96336]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-537f7865-f1f2-4f39-b860-f9695cb085f1 tempest-SnapshotsActionsTest-26926918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e" returned: 0 in 1.005s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-537f7865-f1f2-4f39-b860-f9695cb085f1 tempest-SnapshotsActionsTest-26926918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:33:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-537f7865-f1f2-4f39-b860-f9695cb085f1 tempest-SnapshotsActionsTest-26926918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.dae00a3d-1400-4596-9f64-051a8f6cb8ff {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:35 devstack sudo[96351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.dae00a3d-1400-4596-9f64-051a8f6cb8ff Jun 04 06:33:35 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:36 devstack sudo[96349]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1879c2cb-ff55-4b69-bf8d-d7e105629fa4 tempest-VolumesListAdminTestJSON-2078268913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9ed20c8b-72d3-4dff-a0a4-a706988a5a9f" returned: 0 in 0.896s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:36 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1879c2cb-ff55-4b69-bf8d-d7e105629fa4 tempest-VolumesListAdminTestJSON-2078268913 None] Lock "cinder-quobyte-9ed20c8b-72d3-4dff-a0a4-a706988a5a9f" released by "delete_volume" :: held 2.029s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:33:36 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-1879c2cb-ff55-4b69-bf8d-d7e105629fa4 tempest-VolumesListAdminTestJSON-2078268913 None] Created reservations ['246b1706-2a55-41b7-8eb4-401b2489c30c', 'c1e9c235-7c6c-43a2-867b-122dd1a6bdb9', 'ee4ccbba-d7d8-4a47-9cff-a875f73c0703', '26c0f903-0a7a-431e-9693-bd6f7bd4a963'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:33:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-1879c2cb-ff55-4b69-bf8d-d7e105629fa4 tempest-VolumesListAdminTestJSON-2078268913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:33:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-1879c2cb-ff55-4b69-bf8d-d7e105629fa4 tempest-VolumesListAdminTestJSON-2078268913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:33:36 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-1879c2cb-ff55-4b69-bf8d-d7e105629fa4 tempest-VolumesListAdminTestJSON-2078268913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:33:36 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-1879c2cb-ff55-4b69-bf8d-d7e105629fa4 tempest-VolumesListAdminTestJSON-2078268913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:33:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-1879c2cb-ff55-4b69-bf8d-d7e105629fa4 tempest-VolumesListAdminTestJSON-2078268913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:33:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1879c2cb-ff55-4b69-bf8d-d7e105629fa4 tempest-VolumesListAdminTestJSON-2078268913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:36 devstack sudo[96358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:33:36 devstack sudo[96358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:36 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-537f7865-f1f2-4f39-b860-f9695cb085f1 tempest-SnapshotsActionsTest-26926918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.dae00a3d-1400-4596-9f64-051a8f6cb8ff" returned: 0 in 1.302s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-537f7865-f1f2-4f39-b860-f9695cb085f1 tempest-SnapshotsActionsTest-26926918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.dae00a3d-1400-4596-9f64-051a8f6cb8ff {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:36 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:33:36 devstack sudo[96360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.dae00a3d-1400-4596-9f64-051a8f6cb8ff Jun 04 06:33:36 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:36 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] Flow 'volume_create_manager' (8f73e087-3473-4a1c-ab2e-266e371ea362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:33:36 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fea53b19-ca7f-4fa8-8e25-984f2f4371cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:36 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fea53b19-ca7f-4fa8-8e25-984f2f4371cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1195488892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81546726-b5c2-4dd5-9a1c-d380fe111288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f0ce7b1e3fb4b77910326b28e19f0d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:33:37Z,use_quota=True,user_id='3c1b7e9dbf274c768c5a42119d15e34f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:36 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0839183-4e2f-4ba1-9867-c564ab745ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:36 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0839183-4e2f-4ba1-9867-c564ab745ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:36 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12c4f47b-6b1e-49f5-9f40-c60801fdf467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:36 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12c4f47b-6b1e-49f5-9f40-c60801fdf467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81546726-b5c2-4dd5-9a1c-d380fe111288', 'volume_name': 'volume-81546726-b5c2-4dd5-9a1c-d380fe111288', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:36 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (322b1e31-c6e2-46a9-8b33-3f51da17ee8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:36 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (322b1e31-c6e2-46a9-8b33-3f51da17ee8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:36 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ba7723-6b6c-4601-a7bb-a29acda00238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:36 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] Volume 81546726-b5c2-4dd5-9a1c-d380fe111288: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81546726-b5c2-4dd5-9a1c-d380fe111288', 'volume_size': 1} Jun 04 06:33:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:33:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:33:36 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1195488892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81546726-b5c2-4dd5-9a1c-d380fe111288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f0ce7b1e3fb4b77910326b28e19f0d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:33:37Z,use_quota=True,user_id='3c1b7e9dbf274c768c5a42119d15e34f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:33:36 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] Creating volume 81546726-b5c2-4dd5-9a1c-d380fe111288 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:33:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:33:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:33:36 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:33:37 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:33:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:33:37 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:33:37 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:33:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-81546726-b5c2-4dd5-9a1c-d380fe111288 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:37 devstack sudo[96362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-81546726-b5c2-4dd5-9a1c-d380fe111288 1073741824 Jun 04 06:33:37 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:37 devstack sudo[96358]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1879c2cb-ff55-4b69-bf8d-d7e105629fa4 tempest-VolumesListAdminTestJSON-2078268913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.372s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:37 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-1879c2cb-ff55-4b69-bf8d-d7e105629fa4 tempest-VolumesListAdminTestJSON-2078268913 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:33:37 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-1879c2cb-ff55-4b69-bf8d-d7e105629fa4 tempest-VolumesListAdminTestJSON-2078268913 None] Deleted volume successfully. Jun 04 06:33:38 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=78,cinder:UPDATE=85,cinder:INSERT=15,cinder:DELETE=7 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:33:38 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1879c2cb-ff55-4b69-bf8d-d7e105629fa4 tempest-VolumesListAdminTestJSON-2078268913 None] Lock "cinder-9ed20c8b-72d3-4dff-a0a4-a706988a5a9f-delete_volume" released by "delete_volume" :: held 3.925s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:33:38 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-537f7865-f1f2-4f39-b860-f9695cb085f1 tempest-SnapshotsActionsTest-26926918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.dae00a3d-1400-4596-9f64-051a8f6cb8ff" returned: 0 in 1.459s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:38 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-537f7865-f1f2-4f39-b860-f9695cb085f1 tempest-SnapshotsActionsTest-26926918 None] Lock "cinder-quobyte-dae00a3d-1400-4596-9f64-051a8f6cb8ff" released by "_delete_snapshot" :: held 5.470s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:33:38 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-537f7865-f1f2-4f39-b860-f9695cb085f1 tempest-SnapshotsActionsTest-26926918 None] Lock "cinder-quobyte-ec4b535f-b5cd-4bdc-acca-76e2e5c23941" released by "delete_snapshot" :: held 5.499s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:33:38 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-81546726-b5c2-4dd5-9a1c-d380fe111288 1073741824" returned: 0 in 1.468s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:38 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-537f7865-f1f2-4f39-b860-f9695cb085f1 tempest-SnapshotsActionsTest-26926918 None] Created reservations ['1eb480ff-db2f-4ccf-8b05-b97ddf62d6b2', '59f0e11a-903f-4dbf-805e-20b6f9d71814', 'b2ee9d6b-0e8c-4ca3-9969-d5d276a6e987', 'ec49f1a2-ed2f-4d97-89aa-3149f7076e0a'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:33:38 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:UPDATE=83,cinder:SELECT=81,cinder:INSERT=26,cinder:DELETE=9 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:33:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-81546726-b5c2-4dd5-9a1c-d380fe111288 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:38 devstack sudo[96377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-81546726-b5c2-4dd5-9a1c-d380fe111288 Jun 04 06:33:38 devstack sudo[96377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:38 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-537f7865-f1f2-4f39-b860-f9695cb085f1 tempest-SnapshotsActionsTest-26926918 None] Delete snapshot completed successfully. Jun 04 06:33:38 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-537f7865-f1f2-4f39-b860-f9695cb085f1 tempest-SnapshotsActionsTest-26926918 None] Lock "cinder-dae00a3d-1400-4596-9f64-051a8f6cb8ff-delete_snapshot" released by "delete_snapshot" :: held 5.915s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:33:39 devstack sudo[96377]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-81546726-b5c2-4dd5-9a1c-d380fe111288" returned: 0 in 1.060s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:39 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] <== create_volume: return (2614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:33:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.617s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:33:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ba7723-6b6c-4601-a7bb-a29acda00238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81546726-b5c2-4dd5-9a1c-d380fe111288', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3da9dc9a-dc52-41d2-bc05-70c7132a24af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:39 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] Volume volume-81546726-b5c2-4dd5-9a1c-d380fe111288 (81546726-b5c2-4dd5-9a1c-d380fe111288): created successfully Jun 04 06:33:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3da9dc9a-dc52-41d2-bc05-70c7132a24af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] Flow 'volume_create_manager' (8f73e087-3473-4a1c-ab2e-266e371ea362) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:33:39 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-94342f9b-f427-43f0-9886-0c4ddee0ae7a tempest-ServerRescueNegativeTestJSON-799822107 None] Created volume successfully. Jun 04 06:33:40 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-f3776efe-27d3-4b51-b13f-65514a15786b tempest-SnapshotsActionsTest-1916206556 None] Acquiring lock "cinder-f516ee87-118d-4c82-9ed4-4a079265dc2e-delete_snapshot" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:33:40 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-f3776efe-27d3-4b51-b13f-65514a15786b tempest-SnapshotsActionsTest-1916206556 None] Lock "cinder-f516ee87-118d-4c82-9ed4-4a079265dc2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.074s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:33:40 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-f3776efe-27d3-4b51-b13f-65514a15786b tempest-SnapshotsActionsTest-1916206556 None] Acquiring lock "cinder-quobyte-ec4b535f-b5cd-4bdc-acca-76e2e5c23941" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:33:40 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-f3776efe-27d3-4b51-b13f-65514a15786b tempest-SnapshotsActionsTest-1916206556 None] Lock "cinder-quobyte-ec4b535f-b5cd-4bdc-acca-76e2e5c23941" acquired by "delete_snapshot" :: waited 0.075s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:33:40 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-f3776efe-27d3-4b51-b13f-65514a15786b tempest-SnapshotsActionsTest-1916206556 None] Acquiring lock "cinder-quobyte-f516ee87-118d-4c82-9ed4-4a079265dc2e" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:33:40 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-f3776efe-27d3-4b51-b13f-65514a15786b tempest-SnapshotsActionsTest-1916206556 None] Lock "cinder-quobyte-f516ee87-118d-4c82-9ed4-4a079265dc2e" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:33:40 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-f3776efe-27d3-4b51-b13f-65514a15786b tempest-SnapshotsActionsTest-1916206556 None] Deleting offline snapshot f516ee87-118d-4c82-9ed4-4a079265dc2e of volume ec4b535f-b5cd-4bdc-acca-76e2e5c23941 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:33:40 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-f3776efe-27d3-4b51-b13f-65514a15786b tempest-SnapshotsActionsTest-1916206556 None] snapshot_file for this snap is: volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:33:40 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9747e3-0fd5-46e0-9ba6-b37099cc5730]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:33:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f3776efe-27d3-4b51-b13f-65514a15786b tempest-SnapshotsActionsTest-1916206556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:41 devstack sudo[96409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e Jun 04 06:33:41 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:42 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f3776efe-27d3-4b51-b13f-65514a15786b tempest-SnapshotsActionsTest-1916206556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e" returned: 0 in 1.609s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:42 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-f3776efe-27d3-4b51-b13f-65514a15786b tempest-SnapshotsActionsTest-1916206556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:33:42 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[b900c4f4-615e-4f3d-af5c-54d85e968301]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:33:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f3776efe-27d3-4b51-b13f-65514a15786b tempest-SnapshotsActionsTest-1916206556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:42 devstack sudo[96416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941 Jun 04 06:33:42 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:43 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f3776efe-27d3-4b51-b13f-65514a15786b tempest-SnapshotsActionsTest-1916206556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941" returned: 0 in 1.449s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f3776efe-27d3-4b51-b13f-65514a15786b tempest-SnapshotsActionsTest-1916206556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:43 devstack sudo[96421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e Jun 04 06:33:43 devstack sudo[96421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:44 devstack sudo[96421]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f3776efe-27d3-4b51-b13f-65514a15786b tempest-SnapshotsActionsTest-1916206556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e" returned: 0 in 0.893s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f3776efe-27d3-4b51-b13f-65514a15786b tempest-SnapshotsActionsTest-1916206556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:44 devstack sudo[96427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e Jun 04 06:33:44 devstack sudo[96427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:45 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:33:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] Flow 'volume_create_manager' (dbb1ad46-7c2e-475c-a591-e1b3ec7d35b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:33:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7381fc7-a6fa-4f61-acd5-b0105a4da01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7381fc7-a6fa-4f61-acd5-b0105a4da01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1558818105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6210789-dc13-4e52-81a7-f6659842362a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cf692c55d0646e5beff4dbedb0dfcf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:33:45Z,use_quota=True,user_id='8afb3a3810dc45a5993171975574fa3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (309ccc97-6f50-4c17-a27a-56d01c40bbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (309ccc97-6f50-4c17-a27a-56d01c40bbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe30865-ee1b-40e9-a427-6560d4a81ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe30865-ee1b-40e9-a427-6560d4a81ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6210789-dc13-4e52-81a7-f6659842362a', 'volume_name': 'volume-c6210789-dc13-4e52-81a7-f6659842362a', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381040b9-20a2-41fb-bb9b-4a04d38f121e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381040b9-20a2-41fb-bb9b-4a04d38f121e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (628ea4c7-70f3-4183-8ef5-77bef3321e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:45 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] Volume c6210789-dc13-4e52-81a7-f6659842362a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6210789-dc13-4e52-81a7-f6659842362a', 'volume_size': 1} Jun 04 06:33:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:33:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:33:45 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1558818105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6210789-dc13-4e52-81a7-f6659842362a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cf692c55d0646e5beff4dbedb0dfcf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:33:45Z,use_quota=True,user_id='8afb3a3810dc45a5993171975574fa3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:33:45 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] Creating volume c6210789-dc13-4e52-81a7-f6659842362a {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:33:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:33:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:33:45 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:33:45 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:33:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:33:45 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:33:45 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:33:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:45 devstack sudo[96436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a 1073741824 Jun 04 06:33:45 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:46 devstack sudo[96427]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f3776efe-27d3-4b51-b13f-65514a15786b tempest-SnapshotsActionsTest-1916206556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941.f516ee87-118d-4c82-9ed4-4a079265dc2e" returned: 0 in 1.323s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:46 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-f3776efe-27d3-4b51-b13f-65514a15786b tempest-SnapshotsActionsTest-1916206556 None] Lock "cinder-quobyte-f516ee87-118d-4c82-9ed4-4a079265dc2e" released by "_delete_snapshot" :: held 5.610s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:33:46 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-f3776efe-27d3-4b51-b13f-65514a15786b tempest-SnapshotsActionsTest-1916206556 None] Lock "cinder-quobyte-ec4b535f-b5cd-4bdc-acca-76e2e5c23941" released by "delete_snapshot" :: held 5.673s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:33:46 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-f3776efe-27d3-4b51-b13f-65514a15786b tempest-SnapshotsActionsTest-1916206556 None] Created reservations ['2fc3c39b-8233-4117-a40d-6a9debbfda97', '253e5997-2784-406a-9ec3-d6ac9d58e96b', 'dacb47d3-36f0-4ff7-82ae-b12c5cf85f13', '15a64b19-8e66-47da-a10e-5077c59e84f2'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:33:46 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-f3776efe-27d3-4b51-b13f-65514a15786b tempest-SnapshotsActionsTest-1916206556 None] Delete snapshot completed successfully. Jun 04 06:33:46 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-f3776efe-27d3-4b51-b13f-65514a15786b tempest-SnapshotsActionsTest-1916206556 None] Lock "cinder-f516ee87-118d-4c82-9ed4-4a079265dc2e-delete_snapshot" released by "delete_snapshot" :: held 5.980s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:33:46 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a 1073741824" returned: 0 in 1.399s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:46 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a Jun 04 06:33:46 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:47 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-92323ad6-9e14-408b-b037-87d96d2e5846 tempest-SnapshotsActionsTest-1916206556 None] Acquiring lock "cinder-ec4b535f-b5cd-4bdc-acca-76e2e5c23941-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:33:47 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-92323ad6-9e14-408b-b037-87d96d2e5846 tempest-SnapshotsActionsTest-1916206556 None] Lock "cinder-ec4b535f-b5cd-4bdc-acca-76e2e5c23941-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:33:47 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-92323ad6-9e14-408b-b037-87d96d2e5846 tempest-SnapshotsActionsTest-1916206556 None] Acquiring lock "cinder-quobyte-ec4b535f-b5cd-4bdc-acca-76e2e5c23941" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:33:47 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-92323ad6-9e14-408b-b037-87d96d2e5846 tempest-SnapshotsActionsTest-1916206556 None] Lock "cinder-quobyte-ec4b535f-b5cd-4bdc-acca-76e2e5c23941" acquired by "delete_volume" :: waited 0.040s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:33:47 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bf8fd7-eb25-45ba-95da-37b1ef27bcb9]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:33:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-92323ad6-9e14-408b-b037-87d96d2e5846 tempest-SnapshotsActionsTest-1916206556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:47 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941 Jun 04 06:33:47 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:47 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a" returned: 0 in 0.974s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:47 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] <== create_volume: return (2463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:33:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.479s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:33:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (628ea4c7-70f3-4183-8ef5-77bef3321e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6210789-dc13-4e52-81a7-f6659842362a', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36770f10-b98c-4862-9b3c-9142e1f8b11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:33:47 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] Volume volume-c6210789-dc13-4e52-81a7-f6659842362a (c6210789-dc13-4e52-81a7-f6659842362a): created successfully Jun 04 06:33:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36770f10-b98c-4862-9b3c-9142e1f8b11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:33:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] Flow 'volume_create_manager' (dbb1ad46-7c2e-475c-a591-e1b3ec7d35b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:33:47 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-982b2e44-80f5-44a0-93f1-36988f60ac5c tempest-SnapshotMetadataTestJSON-127474352 None] Created volume successfully. Jun 04 06:33:48 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d7feb5c9-a3d4-4e58-981b-3aca0d24d93b tempest-TestServerVolumeAttachmentScenario-549008027 None] Acquiring lock "cinder-9bdaa617-c1e6-4056-814e-3920134ce9d5-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:33:48 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d7feb5c9-a3d4-4e58-981b-3aca0d24d93b tempest-TestServerVolumeAttachmentScenario-549008027 None] Lock "cinder-9bdaa617-c1e6-4056-814e-3920134ce9d5-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:33:48 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d7feb5c9-a3d4-4e58-981b-3aca0d24d93b tempest-TestServerVolumeAttachmentScenario-549008027 None] Acquiring lock "cinder-quobyte-9bdaa617-c1e6-4056-814e-3920134ce9d5" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:33:48 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d7feb5c9-a3d4-4e58-981b-3aca0d24d93b tempest-TestServerVolumeAttachmentScenario-549008027 None] Lock "cinder-quobyte-9bdaa617-c1e6-4056-814e-3920134ce9d5" acquired by "delete_volume" :: waited 0.053s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:33:48 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-92323ad6-9e14-408b-b037-87d96d2e5846 tempest-SnapshotsActionsTest-1916206556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941" returned: 0 in 1.242s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-92323ad6-9e14-408b-b037-87d96d2e5846 tempest-SnapshotsActionsTest-1916206556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:48 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef162b43-25dc-45c8-b2f7-e714e92cf025]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:33:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d7feb5c9-a3d4-4e58-981b-3aca0d24d93b tempest-TestServerVolumeAttachmentScenario-549008027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9bdaa617-c1e6-4056-814e-3920134ce9d5 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:48 devstack sudo[96511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941 Jun 04 06:33:48 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a950852f-c7e9-4e55-a135-5b3de2a88714 tempest-SnapshotMetadataTestJSON-127474352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:33:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a950852f-c7e9-4e55-a135-5b3de2a88714 tempest-SnapshotMetadataTestJSON-127474352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:33:48 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-a950852f-c7e9-4e55-a135-5b3de2a88714 tempest-SnapshotMetadataTestJSON-127474352 None] Creating offline snapshot 07b52ea5-84ab-4951-97a8-7360e14f7258 of volume c6210789-dc13-4e52-81a7-f6659842362a {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:33:48 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[769bd6ce-3814-4b1f-8df4-3d038ffece95]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:33:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a950852f-c7e9-4e55-a135-5b3de2a88714 tempest-SnapshotMetadataTestJSON-127474352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:48 devstack sudo[96513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9bdaa617-c1e6-4056-814e-3920134ce9d5 Jun 04 06:33:48 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:48 devstack sudo[96514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a Jun 04 06:33:48 devstack sudo[96514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:49 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-92323ad6-9e14-408b-b037-87d96d2e5846 tempest-SnapshotsActionsTest-1916206556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ec4b535f-b5cd-4bdc-acca-76e2e5c23941" returned: 0 in 0.753s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:49 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-92323ad6-9e14-408b-b037-87d96d2e5846 tempest-SnapshotsActionsTest-1916206556 None] Lock "cinder-quobyte-ec4b535f-b5cd-4bdc-acca-76e2e5c23941" released by "delete_volume" :: held 2.118s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:33:49 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-92323ad6-9e14-408b-b037-87d96d2e5846 tempest-SnapshotsActionsTest-1916206556 None] Created reservations ['6a305623-a5fc-4870-a2fb-644f8edae707', '3986b67b-93be-41c6-9c74-f4eb760e3d87', '0cbce3bd-6590-41a2-a584-d69d366fc546', 'cbcd1377-f4d5-44bf-b10d-9b1350bb0051'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:33:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-92323ad6-9e14-408b-b037-87d96d2e5846 tempest-SnapshotsActionsTest-1916206556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:33:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-92323ad6-9e14-408b-b037-87d96d2e5846 tempest-SnapshotsActionsTest-1916206556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:33:49 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-92323ad6-9e14-408b-b037-87d96d2e5846 tempest-SnapshotsActionsTest-1916206556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:33:49 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-92323ad6-9e14-408b-b037-87d96d2e5846 tempest-SnapshotsActionsTest-1916206556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:33:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-92323ad6-9e14-408b-b037-87d96d2e5846 tempest-SnapshotsActionsTest-1916206556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:33:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-92323ad6-9e14-408b-b037-87d96d2e5846 tempest-SnapshotsActionsTest-1916206556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:49 devstack sudo[96526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:33:49 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:49 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d7feb5c9-a3d4-4e58-981b-3aca0d24d93b tempest-TestServerVolumeAttachmentScenario-549008027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9bdaa617-c1e6-4056-814e-3920134ce9d5" returned: 0 in 0.935s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d7feb5c9-a3d4-4e58-981b-3aca0d24d93b tempest-TestServerVolumeAttachmentScenario-549008027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9bdaa617-c1e6-4056-814e-3920134ce9d5 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:49 devstack sudo[96528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9bdaa617-c1e6-4056-814e-3920134ce9d5 Jun 04 06:33:49 devstack sudo[96528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:49 devstack sudo[96514]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a950852f-c7e9-4e55-a135-5b3de2a88714 tempest-SnapshotMetadataTestJSON-127474352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a" returned: 0 in 0.885s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a950852f-c7e9-4e55-a135-5b3de2a88714 tempest-SnapshotMetadataTestJSON-127474352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a.07b52ea5-84ab-4951-97a8-7360e14f7258 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:49 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a.07b52ea5-84ab-4951-97a8-7360e14f7258 1G Jun 04 06:33:49 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:50 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-92323ad6-9e14-408b-b037-87d96d2e5846 tempest-SnapshotsActionsTest-1916206556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.799s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:50 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-92323ad6-9e14-408b-b037-87d96d2e5846 tempest-SnapshotsActionsTest-1916206556 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:33:50 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-92323ad6-9e14-408b-b037-87d96d2e5846 tempest-SnapshotsActionsTest-1916206556 None] Deleted volume successfully. Jun 04 06:33:50 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-92323ad6-9e14-408b-b037-87d96d2e5846 tempest-SnapshotsActionsTest-1916206556 None] Lock "cinder-ec4b535f-b5cd-4bdc-acca-76e2e5c23941-delete_volume" released by "delete_volume" :: held 3.229s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:33:50 devstack sudo[96528]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d7feb5c9-a3d4-4e58-981b-3aca0d24d93b tempest-TestServerVolumeAttachmentScenario-549008027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9bdaa617-c1e6-4056-814e-3920134ce9d5" returned: 0 in 0.823s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:50 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d7feb5c9-a3d4-4e58-981b-3aca0d24d93b tempest-TestServerVolumeAttachmentScenario-549008027 None] Lock "cinder-quobyte-9bdaa617-c1e6-4056-814e-3920134ce9d5" released by "delete_volume" :: held 1.876s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:33:50 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-d7feb5c9-a3d4-4e58-981b-3aca0d24d93b tempest-TestServerVolumeAttachmentScenario-549008027 None] Created reservations ['a3b4a95b-85c7-4458-abf7-9b42f664590b', 'fd45438c-4fa9-47e8-b71e-6edcf9a625f8', '60817800-d16b-421c-a3d4-67f1816ab6f1', 'ec641ceb-d118-4977-86db-2199fa8b656c'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:33:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d7feb5c9-a3d4-4e58-981b-3aca0d24d93b tempest-TestServerVolumeAttachmentScenario-549008027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:33:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d7feb5c9-a3d4-4e58-981b-3aca0d24d93b tempest-TestServerVolumeAttachmentScenario-549008027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:33:50 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d7feb5c9-a3d4-4e58-981b-3aca0d24d93b tempest-TestServerVolumeAttachmentScenario-549008027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:33:50 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d7feb5c9-a3d4-4e58-981b-3aca0d24d93b tempest-TestServerVolumeAttachmentScenario-549008027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:33:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d7feb5c9-a3d4-4e58-981b-3aca0d24d93b tempest-TestServerVolumeAttachmentScenario-549008027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:33:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d7feb5c9-a3d4-4e58-981b-3aca0d24d93b tempest-TestServerVolumeAttachmentScenario-549008027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:50 devstack sudo[96537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:33:50 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:50 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a950852f-c7e9-4e55-a135-5b3de2a88714 tempest-SnapshotMetadataTestJSON-127474352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a.07b52ea5-84ab-4951-97a8-7360e14f7258 1G" returned: 0 in 1.154s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a950852f-c7e9-4e55-a135-5b3de2a88714 tempest-SnapshotMetadataTestJSON-127474352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6210789-dc13-4e52-81a7-f6659842362a -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a.07b52ea5-84ab-4951-97a8-7360e14f7258 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:50 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6210789-dc13-4e52-81a7-f6659842362a -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a.07b52ea5-84ab-4951-97a8-7360e14f7258 Jun 04 06:33:50 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:51 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-99ebb7e3-99ed-45dd-bfbe-8f3cb6d74451 tempest-TestServerVolumeAttachmentScenario-549008027 None] Acquiring lock "cinder-451cfba6-d340-4967-bb50-350d97344a2a-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:33:51 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-99ebb7e3-99ed-45dd-bfbe-8f3cb6d74451 tempest-TestServerVolumeAttachmentScenario-549008027 None] Lock "cinder-451cfba6-d340-4967-bb50-350d97344a2a-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:33:51 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-99ebb7e3-99ed-45dd-bfbe-8f3cb6d74451 tempest-TestServerVolumeAttachmentScenario-549008027 None] Acquiring lock "cinder-quobyte-451cfba6-d340-4967-bb50-350d97344a2a" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:33:51 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-99ebb7e3-99ed-45dd-bfbe-8f3cb6d74451 tempest-TestServerVolumeAttachmentScenario-549008027 None] Lock "cinder-quobyte-451cfba6-d340-4967-bb50-350d97344a2a" acquired by "delete_volume" :: waited 0.057s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:33:51 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9439be-13d2-4a60-9bfe-25c585b81728]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:33:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-99ebb7e3-99ed-45dd-bfbe-8f3cb6d74451 tempest-TestServerVolumeAttachmentScenario-549008027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-451cfba6-d340-4967-bb50-350d97344a2a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:51 devstack sudo[96580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-451cfba6-d340-4967-bb50-350d97344a2a Jun 04 06:33:51 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:52 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d7feb5c9-a3d4-4e58-981b-3aca0d24d93b tempest-TestServerVolumeAttachmentScenario-549008027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.374s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:52 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-d7feb5c9-a3d4-4e58-981b-3aca0d24d93b tempest-TestServerVolumeAttachmentScenario-549008027 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:33:52 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-d7feb5c9-a3d4-4e58-981b-3aca0d24d93b tempest-TestServerVolumeAttachmentScenario-549008027 None] Deleted volume successfully. Jun 04 06:33:52 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d7feb5c9-a3d4-4e58-981b-3aca0d24d93b tempest-TestServerVolumeAttachmentScenario-549008027 None] Lock "cinder-9bdaa617-c1e6-4056-814e-3920134ce9d5-delete_volume" released by "delete_volume" :: held 3.671s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:33:52 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a950852f-c7e9-4e55-a135-5b3de2a88714 tempest-SnapshotMetadataTestJSON-127474352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6210789-dc13-4e52-81a7-f6659842362a -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a.07b52ea5-84ab-4951-97a8-7360e14f7258" returned: 0 in 1.577s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:52 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-a950852f-c7e9-4e55-a135-5b3de2a88714 tempest-SnapshotMetadataTestJSON-127474352 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a.07b52ea5-84ab-4951-97a8-7360e14f7258 is being set with open permissions: ugo+rw Jun 04 06:33:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a950852f-c7e9-4e55-a135-5b3de2a88714 tempest-SnapshotMetadataTestJSON-127474352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a.07b52ea5-84ab-4951-97a8-7360e14f7258 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:52 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a.07b52ea5-84ab-4951-97a8-7360e14f7258 Jun 04 06:33:52 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:52 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-99ebb7e3-99ed-45dd-bfbe-8f3cb6d74451 tempest-TestServerVolumeAttachmentScenario-549008027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-451cfba6-d340-4967-bb50-350d97344a2a" returned: 0 in 1.331s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-99ebb7e3-99ed-45dd-bfbe-8f3cb6d74451 tempest-TestServerVolumeAttachmentScenario-549008027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-451cfba6-d340-4967-bb50-350d97344a2a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:52 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-451cfba6-d340-4967-bb50-350d97344a2a Jun 04 06:33:52 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:53 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a950852f-c7e9-4e55-a135-5b3de2a88714 tempest-SnapshotMetadataTestJSON-127474352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a.07b52ea5-84ab-4951-97a8-7360e14f7258" returned: 0 in 0.867s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a950852f-c7e9-4e55-a135-5b3de2a88714 tempest-SnapshotMetadataTestJSON-127474352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:53 devstack sudo[96597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a.info Jun 04 06:33:53 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:54 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-99ebb7e3-99ed-45dd-bfbe-8f3cb6d74451 tempest-TestServerVolumeAttachmentScenario-549008027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-451cfba6-d340-4967-bb50-350d97344a2a" returned: 0 in 1.406s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:54 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-99ebb7e3-99ed-45dd-bfbe-8f3cb6d74451 tempest-TestServerVolumeAttachmentScenario-549008027 None] Lock "cinder-quobyte-451cfba6-d340-4967-bb50-350d97344a2a" released by "delete_volume" :: held 2.871s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:33:54 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-99ebb7e3-99ed-45dd-bfbe-8f3cb6d74451 tempest-TestServerVolumeAttachmentScenario-549008027 None] Created reservations ['953180c0-f60e-4a86-8a50-57c849c9b836', '60699cdf-5e7e-4213-b592-4eadcf60f923', '261b7598-3bad-4989-83f5-d3922226b284', '12bfe8ee-7fd6-4af9-8b66-8c28dd0cd898'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:33:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-99ebb7e3-99ed-45dd-bfbe-8f3cb6d74451 tempest-TestServerVolumeAttachmentScenario-549008027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:33:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-99ebb7e3-99ed-45dd-bfbe-8f3cb6d74451 tempest-TestServerVolumeAttachmentScenario-549008027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:33:54 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-99ebb7e3-99ed-45dd-bfbe-8f3cb6d74451 tempest-TestServerVolumeAttachmentScenario-549008027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:33:54 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-99ebb7e3-99ed-45dd-bfbe-8f3cb6d74451 tempest-TestServerVolumeAttachmentScenario-549008027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:33:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-99ebb7e3-99ed-45dd-bfbe-8f3cb6d74451 tempest-TestServerVolumeAttachmentScenario-549008027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:33:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-99ebb7e3-99ed-45dd-bfbe-8f3cb6d74451 tempest-TestServerVolumeAttachmentScenario-549008027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:54 devstack sudo[96603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:33:54 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:54 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a950852f-c7e9-4e55-a135-5b3de2a88714 tempest-SnapshotMetadataTestJSON-127474352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a.info" returned: 0 in 1.269s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:54 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-a950852f-c7e9-4e55-a135-5b3de2a88714 tempest-SnapshotMetadataTestJSON-127474352 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a.info is being set with open permissions: ugo+rw Jun 04 06:33:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a950852f-c7e9-4e55-a135-5b3de2a88714 tempest-SnapshotMetadataTestJSON-127474352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:54 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a.info Jun 04 06:33:54 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:55 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-99ebb7e3-99ed-45dd-bfbe-8f3cb6d74451 tempest-TestServerVolumeAttachmentScenario-549008027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.826s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:55 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-99ebb7e3-99ed-45dd-bfbe-8f3cb6d74451 tempest-TestServerVolumeAttachmentScenario-549008027 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:33:55 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-99ebb7e3-99ed-45dd-bfbe-8f3cb6d74451 tempest-TestServerVolumeAttachmentScenario-549008027 None] Deleted volume successfully. Jun 04 06:33:55 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-99ebb7e3-99ed-45dd-bfbe-8f3cb6d74451 tempest-TestServerVolumeAttachmentScenario-549008027 None] Lock "cinder-451cfba6-d340-4967-bb50-350d97344a2a-delete_volume" released by "delete_volume" :: held 4.163s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:33:55 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a950852f-c7e9-4e55-a135-5b3de2a88714 tempest-SnapshotMetadataTestJSON-127474352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a.info" returned: 0 in 1.258s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a950852f-c7e9-4e55-a135-5b3de2a88714 tempest-SnapshotMetadataTestJSON-127474352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.170s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:33:56 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-a950852f-c7e9-4e55-a135-5b3de2a88714 tempest-SnapshotMetadataTestJSON-127474352 None] Create snapshot completed successfully Jun 04 06:33:58 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1a8ae053-06c2-4959-9db9-d60ede833757 tempest-SnapshotMetadataTestJSON-127474352 None] Acquiring lock "cinder-07b52ea5-84ab-4951-97a8-7360e14f7258-delete_snapshot" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:33:58 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1a8ae053-06c2-4959-9db9-d60ede833757 tempest-SnapshotMetadataTestJSON-127474352 None] Lock "cinder-07b52ea5-84ab-4951-97a8-7360e14f7258-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:33:58 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1a8ae053-06c2-4959-9db9-d60ede833757 tempest-SnapshotMetadataTestJSON-127474352 None] Acquiring lock "cinder-quobyte-c6210789-dc13-4e52-81a7-f6659842362a" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:33:58 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1a8ae053-06c2-4959-9db9-d60ede833757 tempest-SnapshotMetadataTestJSON-127474352 None] Lock "cinder-quobyte-c6210789-dc13-4e52-81a7-f6659842362a" acquired by "delete_snapshot" :: waited 0.065s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:33:58 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1a8ae053-06c2-4959-9db9-d60ede833757 tempest-SnapshotMetadataTestJSON-127474352 None] Acquiring lock "cinder-quobyte-07b52ea5-84ab-4951-97a8-7360e14f7258" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:33:58 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1a8ae053-06c2-4959-9db9-d60ede833757 tempest-SnapshotMetadataTestJSON-127474352 None] Lock "cinder-quobyte-07b52ea5-84ab-4951-97a8-7360e14f7258" acquired by "_delete_snapshot" :: waited 0.063s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:33:58 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-1a8ae053-06c2-4959-9db9-d60ede833757 tempest-SnapshotMetadataTestJSON-127474352 None] Deleting offline snapshot 07b52ea5-84ab-4951-97a8-7360e14f7258 of volume c6210789-dc13-4e52-81a7-f6659842362a {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:33:58 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-1a8ae053-06c2-4959-9db9-d60ede833757 tempest-SnapshotMetadataTestJSON-127474352 None] snapshot_file for this snap is: volume-c6210789-dc13-4e52-81a7-f6659842362a.07b52ea5-84ab-4951-97a8-7360e14f7258 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:33:58 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a60310-d2df-41d7-b708-7849e115d170]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:33:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1a8ae053-06c2-4959-9db9-d60ede833757 tempest-SnapshotMetadataTestJSON-127474352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a.07b52ea5-84ab-4951-97a8-7360e14f7258 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:33:58 devstack sudo[96662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a.07b52ea5-84ab-4951-97a8-7360e14f7258 Jun 04 06:33:58 devstack sudo[96662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:33:59 devstack sudo[96662]: pam_unix(sudo:session): session closed for user root Jun 04 06:33:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1a8ae053-06c2-4959-9db9-d60ede833757 tempest-SnapshotMetadataTestJSON-127474352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a.07b52ea5-84ab-4951-97a8-7360e14f7258" returned: 0 in 1.337s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:33:59 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-1a8ae053-06c2-4959-9db9-d60ede833757 tempest-SnapshotMetadataTestJSON-127474352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6210789-dc13-4e52-81a7-f6659842362a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:33:59 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[2260165f-b9d8-434e-8396-b04267aed876]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:33:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1a8ae053-06c2-4959-9db9-d60ede833757 tempest-SnapshotMetadataTestJSON-127474352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:00 devstack sudo[96686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a Jun 04 06:34:00 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:00 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:34:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] Flow 'volume_create_manager' (0e5e4976-6bb3-457e-ba92-0a2f5375072a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:34:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e6186d-3e1d-4d5d-a07e-2f54742913d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e6186d-3e1d-4d5d-a07e-2f54742913d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-893738371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f06d01e-9816-42e9-bc31-772fdeb9770b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a2ad57721ad4d64aee12aa6c53a5446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:34:01Z,use_quota=True,user_id='6433687d3465446ab323354789e43fd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb02c80c-b9ce-4dcb-95d4-283caae36887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb02c80c-b9ce-4dcb-95d4-283caae36887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a44e9a6b-da52-4457-b7bf-fe161c42c8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a44e9a6b-da52-4457-b7bf-fe161c42c8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f06d01e-9816-42e9-bc31-772fdeb9770b', 'volume_name': 'volume-0f06d01e-9816-42e9-bc31-772fdeb9770b', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f54410-e94b-4309-ae8a-38ee75730c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f54410-e94b-4309-ae8a-38ee75730c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:00 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4fde69a-44e1-46d0-9f4a-359c31733d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:00 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] Volume 0f06d01e-9816-42e9-bc31-772fdeb9770b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f06d01e-9816-42e9-bc31-772fdeb9770b', 'volume_size': 1} Jun 04 06:34:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:34:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:34:00 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-893738371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f06d01e-9816-42e9-bc31-772fdeb9770b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a2ad57721ad4d64aee12aa6c53a5446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:34:01Z,use_quota=True,user_id='6433687d3465446ab323354789e43fd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:34:00 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] Creating volume 0f06d01e-9816-42e9-bc31-772fdeb9770b {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:34:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:34:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:34:00 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:34:00 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:34:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:34:00 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:34:00 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:34:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0f06d01e-9816-42e9-bc31-772fdeb9770b 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:00 devstack sudo[96695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0f06d01e-9816-42e9-bc31-772fdeb9770b 1073741824 Jun 04 06:34:00 devstack sudo[96695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:00 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1a8ae053-06c2-4959-9db9-d60ede833757 tempest-SnapshotMetadataTestJSON-127474352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a" returned: 0 in 1.212s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1a8ae053-06c2-4959-9db9-d60ede833757 tempest-SnapshotMetadataTestJSON-127474352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a.07b52ea5-84ab-4951-97a8-7360e14f7258 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:01 devstack sudo[96697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a.07b52ea5-84ab-4951-97a8-7360e14f7258 Jun 04 06:34:01 devstack sudo[96697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:01 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6b6750c5-458e-4dd0-b489-02c1935adbb9 tempest-ServerRescueNegativeTestJSON-799822107 None] Acquiring lock "cinder-81546726-b5c2-4dd5-9a1c-d380fe111288-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:34:01 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6b6750c5-458e-4dd0-b489-02c1935adbb9 tempest-ServerRescueNegativeTestJSON-799822107 None] Lock "cinder-81546726-b5c2-4dd5-9a1c-d380fe111288-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:34:02 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6b6750c5-458e-4dd0-b489-02c1935adbb9 tempest-ServerRescueNegativeTestJSON-799822107 None] Acquiring lock "cinder-quobyte-81546726-b5c2-4dd5-9a1c-d380fe111288" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:34:02 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6b6750c5-458e-4dd0-b489-02c1935adbb9 tempest-ServerRescueNegativeTestJSON-799822107 None] Lock "cinder-quobyte-81546726-b5c2-4dd5-9a1c-d380fe111288" acquired by "delete_volume" :: waited 0.029s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:34:02 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2db59a-98b8-4d78-a8b0-c1a897655d6c]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:34:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6b6750c5-458e-4dd0-b489-02c1935adbb9 tempest-ServerRescueNegativeTestJSON-799822107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-81546726-b5c2-4dd5-9a1c-d380fe111288 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:02 devstack sudo[96697]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1a8ae053-06c2-4959-9db9-d60ede833757 tempest-SnapshotMetadataTestJSON-127474352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a.07b52ea5-84ab-4951-97a8-7360e14f7258" returned: 0 in 1.406s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1a8ae053-06c2-4959-9db9-d60ede833757 tempest-SnapshotMetadataTestJSON-127474352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a.07b52ea5-84ab-4951-97a8-7360e14f7258 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:02 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-81546726-b5c2-4dd5-9a1c-d380fe111288 Jun 04 06:34:02 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:02 devstack sudo[96707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a.07b52ea5-84ab-4951-97a8-7360e14f7258 Jun 04 06:34:02 devstack sudo[96707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:02 devstack sudo[96695]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0f06d01e-9816-42e9-bc31-772fdeb9770b 1073741824" returned: 0 in 2.021s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0f06d01e-9816-42e9-bc31-772fdeb9770b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:03 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0f06d01e-9816-42e9-bc31-772fdeb9770b Jun 04 06:34:03 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:03 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6b6750c5-458e-4dd0-b489-02c1935adbb9 tempest-ServerRescueNegativeTestJSON-799822107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-81546726-b5c2-4dd5-9a1c-d380fe111288" returned: 0 in 1.354s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6b6750c5-458e-4dd0-b489-02c1935adbb9 tempest-ServerRescueNegativeTestJSON-799822107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-81546726-b5c2-4dd5-9a1c-d380fe111288 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:03 devstack sudo[96707]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1a8ae053-06c2-4959-9db9-d60ede833757 tempest-SnapshotMetadataTestJSON-127474352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a.07b52ea5-84ab-4951-97a8-7360e14f7258" returned: 0 in 1.147s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:03 devstack sudo[96716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-81546726-b5c2-4dd5-9a1c-d380fe111288 Jun 04 06:34:03 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:03 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1a8ae053-06c2-4959-9db9-d60ede833757 tempest-SnapshotMetadataTestJSON-127474352 None] Lock "cinder-quobyte-07b52ea5-84ab-4951-97a8-7360e14f7258" released by "_delete_snapshot" :: held 5.405s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:34:03 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1a8ae053-06c2-4959-9db9-d60ede833757 tempest-SnapshotMetadataTestJSON-127474352 None] Lock "cinder-quobyte-c6210789-dc13-4e52-81a7-f6659842362a" released by "delete_snapshot" :: held 5.477s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:34:03 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-1a8ae053-06c2-4959-9db9-d60ede833757 tempest-SnapshotMetadataTestJSON-127474352 None] Created reservations ['38539cad-5097-4631-8f74-16d0231f46a8', '38808d09-3588-4786-a64c-728ae14e9887', 'befaa640-43df-4def-ab2c-e6a017bf64fd', 'e7cd88c6-e7b9-4493-8824-d796e2ca98e1'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:34:03 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-1a8ae053-06c2-4959-9db9-d60ede833757 tempest-SnapshotMetadataTestJSON-127474352 None] Delete snapshot completed successfully. Jun 04 06:34:03 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1a8ae053-06c2-4959-9db9-d60ede833757 tempest-SnapshotMetadataTestJSON-127474352 None] Lock "cinder-07b52ea5-84ab-4951-97a8-7360e14f7258-delete_snapshot" released by "delete_snapshot" :: held 5.826s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:34:04 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0f06d01e-9816-42e9-bc31-772fdeb9770b" returned: 0 in 1.120s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:04 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] <== create_volume: return (3227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:34:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.229s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:34:04 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4fde69a-44e1-46d0-9f4a-359c31733d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f06d01e-9816-42e9-bc31-772fdeb9770b', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:04 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62b777e8-538d-4c77-84ea-a9ce0f0bf38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:04 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] Volume volume-0f06d01e-9816-42e9-bc31-772fdeb9770b (0f06d01e-9816-42e9-bc31-772fdeb9770b): created successfully Jun 04 06:34:04 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62b777e8-538d-4c77-84ea-a9ce0f0bf38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:04 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] Flow 'volume_create_manager' (0e5e4976-6bb3-457e-ba92-0a2f5375072a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:34:04 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-3b3fa948-752e-44d6-8215-24c6902ba0e1 tempest-VolumesServicesTestJSON-558998894 None] Created volume successfully. Jun 04 06:34:04 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6b6750c5-458e-4dd0-b489-02c1935adbb9 tempest-ServerRescueNegativeTestJSON-799822107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-81546726-b5c2-4dd5-9a1c-d380fe111288" returned: 0 in 0.908s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:04 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6b6750c5-458e-4dd0-b489-02c1935adbb9 tempest-ServerRescueNegativeTestJSON-799822107 None] Lock "cinder-quobyte-81546726-b5c2-4dd5-9a1c-d380fe111288" released by "delete_volume" :: held 2.328s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:34:04 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-6b6750c5-458e-4dd0-b489-02c1935adbb9 tempest-ServerRescueNegativeTestJSON-799822107 None] Created reservations ['77a042c4-3855-4b3d-96d2-613d944cd978', '566335ee-c093-4a7a-b69d-1593f17b90ad', '4b99bb4e-5560-477b-8bdd-6ce9d90e2d88', 'f0fc7d7e-271e-42ec-bf15-a7f6b3591507'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:34:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-6b6750c5-458e-4dd0-b489-02c1935adbb9 tempest-ServerRescueNegativeTestJSON-799822107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:34:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-6b6750c5-458e-4dd0-b489-02c1935adbb9 tempest-ServerRescueNegativeTestJSON-799822107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:34:04 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-6b6750c5-458e-4dd0-b489-02c1935adbb9 tempest-ServerRescueNegativeTestJSON-799822107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:34:04 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-6b6750c5-458e-4dd0-b489-02c1935adbb9 tempest-ServerRescueNegativeTestJSON-799822107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:34:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-6b6750c5-458e-4dd0-b489-02c1935adbb9 tempest-ServerRescueNegativeTestJSON-799822107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:34:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6b6750c5-458e-4dd0-b489-02c1935adbb9 tempest-ServerRescueNegativeTestJSON-799822107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:04 devstack sudo[96721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:34:04 devstack sudo[96721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:04 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9833dd37-bca7-4ce2-a210-76313561bc05 tempest-SnapshotMetadataTestJSON-127474352 None] Acquiring lock "cinder-c6210789-dc13-4e52-81a7-f6659842362a-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:34:04 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9833dd37-bca7-4ce2-a210-76313561bc05 tempest-SnapshotMetadataTestJSON-127474352 None] Lock "cinder-c6210789-dc13-4e52-81a7-f6659842362a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:34:04 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9833dd37-bca7-4ce2-a210-76313561bc05 tempest-SnapshotMetadataTestJSON-127474352 None] Acquiring lock "cinder-quobyte-c6210789-dc13-4e52-81a7-f6659842362a" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:34:04 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9833dd37-bca7-4ce2-a210-76313561bc05 tempest-SnapshotMetadataTestJSON-127474352 None] Lock "cinder-quobyte-c6210789-dc13-4e52-81a7-f6659842362a" acquired by "delete_volume" :: waited 0.026s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:34:04 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[0575381b-5304-46a6-8d20-181e53537924]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:34:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9833dd37-bca7-4ce2-a210-76313561bc05 tempest-SnapshotMetadataTestJSON-127474352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:05 devstack sudo[96723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a Jun 04 06:34:05 devstack sudo[96723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:05 devstack sudo[96721]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6b6750c5-458e-4dd0-b489-02c1935adbb9 tempest-ServerRescueNegativeTestJSON-799822107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.947s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:05 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-6b6750c5-458e-4dd0-b489-02c1935adbb9 tempest-ServerRescueNegativeTestJSON-799822107 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:34:05 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-6b6750c5-458e-4dd0-b489-02c1935adbb9 tempest-ServerRescueNegativeTestJSON-799822107 None] Deleted volume successfully. Jun 04 06:34:05 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6b6750c5-458e-4dd0-b489-02c1935adbb9 tempest-ServerRescueNegativeTestJSON-799822107 None] Lock "cinder-81546726-b5c2-4dd5-9a1c-d380fe111288-delete_volume" released by "delete_volume" :: held 3.629s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:34:05 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9225467f-3d02-471f-b02a-b70bf6ffd246 tempest-VolumesServicesTestJSON-558998894 None] Acquiring lock "cinder-0f06d01e-9816-42e9-bc31-772fdeb9770b-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:34:05 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9225467f-3d02-471f-b02a-b70bf6ffd246 tempest-VolumesServicesTestJSON-558998894 None] Lock "cinder-0f06d01e-9816-42e9-bc31-772fdeb9770b-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:34:06 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9225467f-3d02-471f-b02a-b70bf6ffd246 tempest-VolumesServicesTestJSON-558998894 None] Acquiring lock "cinder-quobyte-0f06d01e-9816-42e9-bc31-772fdeb9770b" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:34:06 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9225467f-3d02-471f-b02a-b70bf6ffd246 tempest-VolumesServicesTestJSON-558998894 None] Lock "cinder-quobyte-0f06d01e-9816-42e9-bc31-772fdeb9770b" acquired by "delete_volume" :: waited 0.042s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:34:06 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f9f8ba-da6c-42af-ba8d-053fcbc73d2b]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:34:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9225467f-3d02-471f-b02a-b70bf6ffd246 tempest-VolumesServicesTestJSON-558998894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0f06d01e-9816-42e9-bc31-772fdeb9770b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:06 devstack sudo[96729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0f06d01e-9816-42e9-bc31-772fdeb9770b Jun 04 06:34:06 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:06 devstack sudo[96723]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9833dd37-bca7-4ce2-a210-76313561bc05 tempest-SnapshotMetadataTestJSON-127474352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a" returned: 0 in 1.555s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9833dd37-bca7-4ce2-a210-76313561bc05 tempest-SnapshotMetadataTestJSON-127474352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:06 devstack sudo[96733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a Jun 04 06:34:06 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:07 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9225467f-3d02-471f-b02a-b70bf6ffd246 tempest-VolumesServicesTestJSON-558998894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0f06d01e-9816-42e9-bc31-772fdeb9770b" returned: 0 in 1.335s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9225467f-3d02-471f-b02a-b70bf6ffd246 tempest-VolumesServicesTestJSON-558998894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0f06d01e-9816-42e9-bc31-772fdeb9770b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:07 devstack sudo[96771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0f06d01e-9816-42e9-bc31-772fdeb9770b Jun 04 06:34:07 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:07 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9833dd37-bca7-4ce2-a210-76313561bc05 tempest-SnapshotMetadataTestJSON-127474352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c6210789-dc13-4e52-81a7-f6659842362a" returned: 0 in 1.189s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:07 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9833dd37-bca7-4ce2-a210-76313561bc05 tempest-SnapshotMetadataTestJSON-127474352 None] Lock "cinder-quobyte-c6210789-dc13-4e52-81a7-f6659842362a" released by "delete_volume" :: held 2.864s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:34:07 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-9833dd37-bca7-4ce2-a210-76313561bc05 tempest-SnapshotMetadataTestJSON-127474352 None] Created reservations ['a30d6732-75a1-43fd-905d-54a3588cceda', '1bc8fe14-05be-4a50-aace-f9211f794da5', '948123b9-d34b-42f1-811e-894a5ed1fb13', '55e976d5-2072-4b03-9f06-ba4cadf1b3b8'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:34:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9833dd37-bca7-4ce2-a210-76313561bc05 tempest-SnapshotMetadataTestJSON-127474352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:34:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9833dd37-bca7-4ce2-a210-76313561bc05 tempest-SnapshotMetadataTestJSON-127474352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:34:08 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-9833dd37-bca7-4ce2-a210-76313561bc05 tempest-SnapshotMetadataTestJSON-127474352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:34:08 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-9833dd37-bca7-4ce2-a210-76313561bc05 tempest-SnapshotMetadataTestJSON-127474352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:34:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9833dd37-bca7-4ce2-a210-76313561bc05 tempest-SnapshotMetadataTestJSON-127474352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:34:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9833dd37-bca7-4ce2-a210-76313561bc05 tempest-SnapshotMetadataTestJSON-127474352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:08 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:34:08 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:09 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9225467f-3d02-471f-b02a-b70bf6ffd246 tempest-VolumesServicesTestJSON-558998894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0f06d01e-9816-42e9-bc31-772fdeb9770b" returned: 0 in 1.862s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:09 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9225467f-3d02-471f-b02a-b70bf6ffd246 tempest-VolumesServicesTestJSON-558998894 None] Lock "cinder-quobyte-0f06d01e-9816-42e9-bc31-772fdeb9770b" released by "delete_volume" :: held 3.295s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:34:09 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9833dd37-bca7-4ce2-a210-76313561bc05 tempest-SnapshotMetadataTestJSON-127474352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.288s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:09 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-9833dd37-bca7-4ce2-a210-76313561bc05 tempest-SnapshotMetadataTestJSON-127474352 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:34:09 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-9833dd37-bca7-4ce2-a210-76313561bc05 tempest-SnapshotMetadataTestJSON-127474352 None] Deleted volume successfully. Jun 04 06:34:09 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9833dd37-bca7-4ce2-a210-76313561bc05 tempest-SnapshotMetadataTestJSON-127474352 None] Lock "cinder-c6210789-dc13-4e52-81a7-f6659842362a-delete_volume" released by "delete_volume" :: held 4.831s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:34:09 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-9225467f-3d02-471f-b02a-b70bf6ffd246 tempest-VolumesServicesTestJSON-558998894 None] Created reservations ['2d9b6983-6e4b-4f1d-af47-60b37a289757', '5c313f50-d00a-4c8f-b0c0-e9f9e3565bd7', '5e485c51-c66a-44b8-96ba-e2d85ebba06b', 'fca3d245-8d3d-4913-9c44-8180066fef6c'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:34:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9225467f-3d02-471f-b02a-b70bf6ffd246 tempest-VolumesServicesTestJSON-558998894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:34:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9225467f-3d02-471f-b02a-b70bf6ffd246 tempest-VolumesServicesTestJSON-558998894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:34:09 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-9225467f-3d02-471f-b02a-b70bf6ffd246 tempest-VolumesServicesTestJSON-558998894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:34:09 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-9225467f-3d02-471f-b02a-b70bf6ffd246 tempest-VolumesServicesTestJSON-558998894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:34:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9225467f-3d02-471f-b02a-b70bf6ffd246 tempest-VolumesServicesTestJSON-558998894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:34:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9225467f-3d02-471f-b02a-b70bf6ffd246 tempest-VolumesServicesTestJSON-558998894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:09 devstack sudo[96789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:34:09 devstack sudo[96789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:10 devstack sudo[96789]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9225467f-3d02-471f-b02a-b70bf6ffd246 tempest-VolumesServicesTestJSON-558998894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.106s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:10 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-9225467f-3d02-471f-b02a-b70bf6ffd246 tempest-VolumesServicesTestJSON-558998894 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:34:10 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-9225467f-3d02-471f-b02a-b70bf6ffd246 tempest-VolumesServicesTestJSON-558998894 None] Deleted volume successfully. Jun 04 06:34:11 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9225467f-3d02-471f-b02a-b70bf6ffd246 tempest-VolumesServicesTestJSON-558998894 None] Lock "cinder-0f06d01e-9816-42e9-bc31-772fdeb9770b-delete_volume" released by "delete_volume" :: held 5.097s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:34:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:34:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:34:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:34:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:34:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:34:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:34:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:11 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:34:11 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:12 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.116s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:12 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:34:12 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager._thread_info {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:34:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread count: 28 {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 06:34:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread info: [<_MainThread(MainThread, started 131797370544256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 06:34:19 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:UPDATE=73,cinder:SELECT=47,cinder:INSERT=14,cinder:DELETE=5 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:34:20 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:34:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Flow 'volume_create_manager' (3fca9223-8127-493b-a979-3c06613aeab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:34:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c61e062-0bad-4602-b7b9-e799893e9707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c61e062-0bad-4602-b7b9-e799893e9707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1881773573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158fa562-e26e-4636-8084-1e74cd38f1c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f21fa0ba980b4059b0d1314e41cae0f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:34:20Z,use_quota=True,user_id='989bbdaf99c143759d9e656b896a4456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3c59f3-5da6-4f7d-a549-decc010b24be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3c59f3-5da6-4f7d-a549-decc010b24be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb963e98-eebf-4c46-8f3e-875f7abb711f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb963e98-eebf-4c46-8f3e-875f7abb711f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '158fa562-e26e-4636-8084-1e74cd38f1c9', 'volume_name': 'volume-158fa562-e26e-4636-8084-1e74cd38f1c9', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f230b62-397e-4f03-b9f0-ac30ccad0465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f230b62-397e-4f03-b9f0-ac30ccad0465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3de2e750-d6cb-4e99-bc98-d339949edacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:20 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Volume 158fa562-e26e-4636-8084-1e74cd38f1c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-158fa562-e26e-4636-8084-1e74cd38f1c9', 'volume_size': 1} Jun 04 06:34:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:34:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:34:20 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1881773573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158fa562-e26e-4636-8084-1e74cd38f1c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f21fa0ba980b4059b0d1314e41cae0f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:34:20Z,use_quota=True,user_id='989bbdaf99c143759d9e656b896a4456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:34:20 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Creating volume 158fa562-e26e-4636-8084-1e74cd38f1c9 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:34:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:34:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:34:20 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:34:20 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:34:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:34:20 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:34:20 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:34:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:20 devstack sudo[96843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9 1073741824 Jun 04 06:34:20 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:21 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9 1073741824" returned: 0 in 1.000s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:21 devstack sudo[96849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9 Jun 04 06:34:21 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:22 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:34:22 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] Flow 'volume_create_manager' (87591022-ca57-4dc6-86fd-21e87fedcbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:34:22 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b51ab00-912d-4886-b44d-4eb9a79a7950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:22 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b51ab00-912d-4886-b44d-4eb9a79a7950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1340959225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38af2b34-7d67-4821-9f2d-7d35c689d755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310e32d67e1441a499c3efac2ab5e403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:34:22Z,use_quota=True,user_id='1864b66e28624180b1af3a8cf3cd049d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:22 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f61db525-6ae4-4241-b91f-59f9a33ba8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:22 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f61db525-6ae4-4241-b91f-59f9a33ba8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:22 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39f5d7bf-f2d5-4e0b-bafe-db14e48b4898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:22 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39f5d7bf-f2d5-4e0b-bafe-db14e48b4898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38af2b34-7d67-4821-9f2d-7d35c689d755', 'volume_name': 'volume-38af2b34-7d67-4821-9f2d-7d35c689d755', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:22 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (923e4ed3-b238-4868-bc51-05773a35e455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:22 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (923e4ed3-b238-4868-bc51-05773a35e455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:22 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93cd82b0-d9a7-456a-9d16-26cdbeb4140a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:22 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] Volume 38af2b34-7d67-4821-9f2d-7d35c689d755: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38af2b34-7d67-4821-9f2d-7d35c689d755', 'volume_size': 1} Jun 04 06:34:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:34:22 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9" returned: 0 in 0.676s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:22 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:34:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:34:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.291s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:34:22 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1340959225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38af2b34-7d67-4821-9f2d-7d35c689d755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310e32d67e1441a499c3efac2ab5e403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:34:22Z,use_quota=True,user_id='1864b66e28624180b1af3a8cf3cd049d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:34:22 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] Creating volume 38af2b34-7d67-4821-9f2d-7d35c689d755 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:34:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:34:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:34:22 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:34:22 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:34:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:34:22 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:34:22 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:34:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-38af2b34-7d67-4821-9f2d-7d35c689d755 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:22 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3de2e750-d6cb-4e99-bc98-d339949edacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-158fa562-e26e-4636-8084-1e74cd38f1c9', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:22 devstack sudo[96852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-38af2b34-7d67-4821-9f2d-7d35c689d755 1073741824 Jun 04 06:34:22 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:22 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a75386e4-057c-4f70-a20d-76a58660ec54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:22 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Volume volume-158fa562-e26e-4636-8084-1e74cd38f1c9 (158fa562-e26e-4636-8084-1e74cd38f1c9): created successfully Jun 04 06:34:22 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a75386e4-057c-4f70-a20d-76a58660ec54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:22 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Flow 'volume_create_manager' (3fca9223-8127-493b-a979-3c06613aeab9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:34:22 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-5195cd01-2829-4c99-bde4-93d26768b161 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Created volume successfully. Jun 04 06:34:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-45023c19-9da5-4021-b1b2-4dec3aba09be tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:34:23 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:34:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Flow 'volume_create_manager' (bf9a74b0-8c2f-4198-850a-1e4f0b79c64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:34:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea7f8f0-c95d-4133-99aa-0d4da9331c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea7f8f0-c95d-4133-99aa-0d4da9331c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34ffeb0a-a759-4dee-a735-a8b719521c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea2448f8f0fa477c947fb1eed7014355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:34:23Z,use_quota=True,user_id='6db1428b3c0e490d93ec8361a90d6359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(083db987-883a-4564-b77b-47f1e59ab1a9),volume_type_id=083db987-883a-4564-b77b-47f1e59ab1a9)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e0b9d1f-f12b-4a80-87f4-27a76697cc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e0b9d1f-f12b-4a80-87f4-27a76697cc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feba84f8-fcf0-4f88-9c35-ddf9f6b47ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:23 devstack cinder-volume[86069]: DEBUG cinder.image.glance [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Creating Keystone auth plugin from conf {{(pid=86069) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 04 06:34:23 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-38af2b34-7d67-4821-9f2d-7d35c689d755 1073741824" returned: 0 in 0.927s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-38af2b34-7d67-4821-9f2d-7d35c689d755 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:23 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-38af2b34-7d67-4821-9f2d-7d35c689d755 Jun 04 06:34:23 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feba84f8-fcf0-4f88-9c35-ddf9f6b47ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '34ffeb0a-a759-4dee-a735-a8b719521c81', 'volume_name': 'volume-34ffeb0a-a759-4dee-a735-a8b719521c81', 'volume_size': 1, 'image_id': '6fd2add9-e03b-4114-aa96-77265cdc109f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6fd2add9-e03b-4114-aa96-77265cdc109f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2484e91a0bc5117d0560a30ac41f2592', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ea2448f8f0fa477c947fb1eed7014355', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a9e19d3f082bf9254bfd2da93e6c4eaa8bbd23e1e45a87a67ca62c02caa8e8f2a725907c9679c9e96ed60d595a214c49025a05e814ef0a1720026821cc784de', 'id': '6fd2add9-e03b-4114-aa96-77265cdc109f', 'created_at': datetime.datetime(2026, 6, 4, 4, 34, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 4, 34, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6fd2add9-e03b-4114-aa96-77265cdc109f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac4a250d-1eaa-4322-8d3f-869f62f4414f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac4a250d-1eaa-4322-8d3f-869f62f4414f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (019e817c-aaa3-4211-bf20-a0d725897e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:23 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Volume 34ffeb0a-a759-4dee-a735-a8b719521c81: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-34ffeb0a-a759-4dee-a735-a8b719521c81', 'volume_size': 1, 'image_id': '6fd2add9-e03b-4114-aa96-77265cdc109f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6fd2add9-e03b-4114-aa96-77265cdc109f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2484e91a0bc5117d0560a30ac41f2592', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ea2448f8f0fa477c947fb1eed7014355', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a9e19d3f082bf9254bfd2da93e6c4eaa8bbd23e1e45a87a67ca62c02caa8e8f2a725907c9679c9e96ed60d595a214c49025a05e814ef0a1720026821cc784de', 'id': '6fd2add9-e03b-4114-aa96-77265cdc109f', 'created_at': datetime.datetime(2026, 6, 4, 4, 34, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 4, 34, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6fd2add9-e03b-4114-aa96-77265cdc109f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 04 06:34:23 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Trying to clone 34ffeb0a-a759-4dee-a735-a8b719521c81 from image 6fd2add9-e03b-4114-aa96-77265cdc109f at location (None, [{'url': 'file:///opt/stack/data/glance/images/6fd2add9-e03b-4114-aa96-77265cdc109f', 'metadata': {}}]). {{(pid=86069) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 04 06:34:23 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6fd2add9-e03b-4114-aa96-77265cdc109f_0qu4r6r9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86069) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 04 06:34:23 devstack cinder-volume[86069]: INFO cinder.image.image_utils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Image download 0.00 MB at 0.00 MB/s Jun 04 06:34:23 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad59782a-10c2-4588-8530-6498df5c13f1]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:34:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6fd2add9-e03b-4114-aa96-77265cdc109f_0qu4r6r9devstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:23 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6fd2add9-e03b-4114-aa96-77265cdc109f_0qu4r6r9devstack@QuobyteHD Jun 04 06:34:23 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:23 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-38af2b34-7d67-4821-9f2d-7d35c689d755" returned: 0 in 0.618s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:23 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:34:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:34:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-45023c19-9da5-4021-b1b2-4dec3aba09be tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.093s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:34:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93cd82b0-d9a7-456a-9d16-26cdbeb4140a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38af2b34-7d67-4821-9f2d-7d35c689d755', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e629519-c701-4a11-afba-d0d08541635c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:24 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-45023c19-9da5-4021-b1b2-4dec3aba09be tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Creating offline snapshot 63421d58-e162-465f-a509-2c39f7a97726 of volume 158fa562-e26e-4636-8084-1e74cd38f1c9 {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:34:24 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] Volume volume-38af2b34-7d67-4821-9f2d-7d35c689d755 (38af2b34-7d67-4821-9f2d-7d35c689d755): created successfully Jun 04 06:34:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e629519-c701-4a11-afba-d0d08541635c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] Flow 'volume_create_manager' (87591022-ca57-4dc6-86fd-21e87fedcbb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:34:24 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1643fa-7327-4afb-b842-8da045a8f62a]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:34:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-45023c19-9da5-4021-b1b2-4dec3aba09be tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:24 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-8da8b476-611f-4570-b421-d7683b148690 tempest-VolumesTransfersV357Test-1210235123 None] Created volume successfully. Jun 04 06:34:24 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9 Jun 04 06:34:24 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:24 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6fd2add9-e03b-4114-aa96-77265cdc109f_0qu4r6r9devstack@QuobyteHD" returned: 0 in 0.714s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6fd2add9-e03b-4114-aa96-77265cdc109f_0qu4r6r9devstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:24 devstack sudo[96867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6fd2add9-e03b-4114-aa96-77265cdc109f_0qu4r6r9devstack@QuobyteHD Jun 04 06:34:24 devstack sudo[96867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:24 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-45023c19-9da5-4021-b1b2-4dec3aba09be tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9" returned: 0 in 0.816s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-45023c19-9da5-4021-b1b2-4dec3aba09be tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9.63421d58-e162-465f-a509-2c39f7a97726 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:24 devstack sudo[96872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9.63421d58-e162-465f-a509-2c39f7a97726 1G Jun 04 06:34:24 devstack sudo[96872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:25 devstack sudo[96867]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6fd2add9-e03b-4114-aa96-77265cdc109f_0qu4r6r9devstack@QuobyteHD" returned: 1 in 0.767s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6fd2add9-e03b-4114-aa96-77265cdc109f_0qu4r6r9devstack@QuobyteHD' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:34:25 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Temporary image 6fd2add9-e03b-4114-aa96-77265cdc109f is fetched for user 6db1428b3c0e490d93ec8361a90d6359. {{(pid=86069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 04 06:34:25 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[329c48e4-0cba-4f3e-a459-a16b8aba04b9]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:34:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6fd2add9-e03b-4114-aa96-77265cdc109f_0qu4r6r9devstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:25 devstack sudo[96877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6fd2add9-e03b-4114-aa96-77265cdc109f_0qu4r6r9devstack@QuobyteHD Jun 04 06:34:25 devstack sudo[96877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:25 devstack sudo[96872]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-45023c19-9da5-4021-b1b2-4dec3aba09be tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9.63421d58-e162-465f-a509-2c39f7a97726 1G" returned: 0 in 1.069s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-45023c19-9da5-4021-b1b2-4dec3aba09be tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-158fa562-e26e-4636-8084-1e74cd38f1c9 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9.63421d58-e162-465f-a509-2c39f7a97726 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:25 devstack sudo[96883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-158fa562-e26e-4636-8084-1e74cd38f1c9 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9.63421d58-e162-465f-a509-2c39f7a97726 Jun 04 06:34:25 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:26 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-e88b51a5-e76f-4da4-bfc7-372c63fd530c tempest-VolumesTransfersV357Test-623487350 None] Transfer volume completed successfully. Jun 04 06:34:26 devstack sudo[96877]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6fd2add9-e03b-4114-aa96-77265cdc109f_0qu4r6r9devstack@QuobyteHD" returned: 0 in 0.988s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6fd2add9-e03b-4114-aa96-77265cdc109f_0qu4r6r9devstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:26 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6fd2add9-e03b-4114-aa96-77265cdc109f_0qu4r6r9devstack@QuobyteHD Jun 04 06:34:26 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:26 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-45023c19-9da5-4021-b1b2-4dec3aba09be tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-158fa562-e26e-4636-8084-1e74cd38f1c9 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9.63421d58-e162-465f-a509-2c39f7a97726" returned: 0 in 0.716s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:26 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-45023c19-9da5-4021-b1b2-4dec3aba09be tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9.63421d58-e162-465f-a509-2c39f7a97726 is being set with open permissions: ugo+rw Jun 04 06:34:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-45023c19-9da5-4021-b1b2-4dec3aba09be tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9.63421d58-e162-465f-a509-2c39f7a97726 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:26 devstack sudo[96894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9.63421d58-e162-465f-a509-2c39f7a97726 Jun 04 06:34:26 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:27 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6fd2add9-e03b-4114-aa96-77265cdc109f_0qu4r6r9devstack@QuobyteHD" returned: 1 in 0.910s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6fd2add9-e03b-4114-aa96-77265cdc109f_0qu4r6r9devstack@QuobyteHD' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:34:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:34:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-725b4065-1963-465d-ac62-c39a7d1ceb74 tempest-VolumesTransfersV357Test-2030422637 None] Acquiring lock "cinder-38af2b34-7d67-4821-9f2d-7d35c689d755-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:34:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-725b4065-1963-465d-ac62-c39a7d1ceb74 tempest-VolumesTransfersV357Test-2030422637 None] Lock "cinder-38af2b34-7d67-4821-9f2d-7d35c689d755-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:34:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-725b4065-1963-465d-ac62-c39a7d1ceb74 tempest-VolumesTransfersV357Test-2030422637 None] Acquiring lock "cinder-quobyte-38af2b34-7d67-4821-9f2d-7d35c689d755" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:34:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-725b4065-1963-465d-ac62-c39a7d1ceb74 tempest-VolumesTransfersV357Test-2030422637 None] Lock "cinder-quobyte-38af2b34-7d67-4821-9f2d-7d35c689d755" acquired by "delete_volume" :: waited 0.018s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:34:27 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e198b7-8e17-4e14-96f2-51f59c60a105]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:34:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-725b4065-1963-465d-ac62-c39a7d1ceb74 tempest-VolumesTransfersV357Test-2030422637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-38af2b34-7d67-4821-9f2d-7d35c689d755 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:27 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-45023c19-9da5-4021-b1b2-4dec3aba09be tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9.63421d58-e162-465f-a509-2c39f7a97726" returned: 0 in 0.880s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:27 devstack sudo[96934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-38af2b34-7d67-4821-9f2d-7d35c689d755 Jun 04 06:34:27 devstack sudo[96934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-45023c19-9da5-4021-b1b2-4dec3aba09be tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:27 devstack sudo[96938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9.info Jun 04 06:34:27 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:28 devstack sudo[96934]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-725b4065-1963-465d-ac62-c39a7d1ceb74 tempest-VolumesTransfersV357Test-2030422637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-38af2b34-7d67-4821-9f2d-7d35c689d755" returned: 0 in 0.813s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-725b4065-1963-465d-ac62-c39a7d1ceb74 tempest-VolumesTransfersV357Test-2030422637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-38af2b34-7d67-4821-9f2d-7d35c689d755 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:28 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-38af2b34-7d67-4821-9f2d-7d35c689d755 Jun 04 06:34:28 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:28 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-45023c19-9da5-4021-b1b2-4dec3aba09be tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9.info" returned: 0 in 0.734s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:28 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-45023c19-9da5-4021-b1b2-4dec3aba09be tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9.info is being set with open permissions: ugo+rw Jun 04 06:34:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-45023c19-9da5-4021-b1b2-4dec3aba09be tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:28 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9.info Jun 04 06:34:28 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:28 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-725b4065-1963-465d-ac62-c39a7d1ceb74 tempest-VolumesTransfersV357Test-2030422637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-38af2b34-7d67-4821-9f2d-7d35c689d755" returned: 0 in 0.680s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:28 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-725b4065-1963-465d-ac62-c39a7d1ceb74 tempest-VolumesTransfersV357Test-2030422637 None] Lock "cinder-quobyte-38af2b34-7d67-4821-9f2d-7d35c689d755" released by "delete_volume" :: held 1.543s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:34:28 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-45023c19-9da5-4021-b1b2-4dec3aba09be tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9.info" returned: 0 in 0.662s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-45023c19-9da5-4021-b1b2-4dec3aba09be tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.011s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:34:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.752s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:34:29 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34ffeb0a-a759-4dee-a735-a8b719521c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea2448f8f0fa477c947fb1eed7014355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:34:23Z,use_quota=True,user_id='6db1428b3c0e490d93ec8361a90d6359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(083db987-883a-4564-b77b-47f1e59ab1a9),volume_type_id=083db987-883a-4564-b77b-47f1e59ab1a9)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:34:29 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Creating volume 34ffeb0a-a759-4dee-a735-a8b719521c81 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:34:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:34:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:34:29 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:34:29 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:34:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:34:29 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:34:29 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:34:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34ffeb0a-a759-4dee-a735-a8b719521c81 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:29 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34ffeb0a-a759-4dee-a735-a8b719521c81 1073741824 Jun 04 06:34:29 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:29 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-725b4065-1963-465d-ac62-c39a7d1ceb74 tempest-VolumesTransfersV357Test-2030422637 None] Created reservations ['e6cd9fb2-c41b-41c0-a4a2-cee936f5dd90', '53b913fa-8806-4d77-a291-24e6878bf96c', '9cc6f7d0-c0a3-4179-bf80-00904f58f578', '688568b9-b00c-4b27-a275-6aa9ba6fb7b2'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:34:29 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-45023c19-9da5-4021-b1b2-4dec3aba09be tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Create snapshot completed successfully Jun 04 06:34:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-725b4065-1963-465d-ac62-c39a7d1ceb74 tempest-VolumesTransfersV357Test-2030422637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:34:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-725b4065-1963-465d-ac62-c39a7d1ceb74 tempest-VolumesTransfersV357Test-2030422637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:34:29 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-725b4065-1963-465d-ac62-c39a7d1ceb74 tempest-VolumesTransfersV357Test-2030422637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:34:29 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-725b4065-1963-465d-ac62-c39a7d1ceb74 tempest-VolumesTransfersV357Test-2030422637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:34:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-725b4065-1963-465d-ac62-c39a7d1ceb74 tempest-VolumesTransfersV357Test-2030422637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:34:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-725b4065-1963-465d-ac62-c39a7d1ceb74 tempest-VolumesTransfersV357Test-2030422637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:29 devstack sudo[96953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:34:29 devstack sudo[96953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:29 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0d2c76e1-0169-418c-bdf0-c27060924baf tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Acquiring lock "cinder-63421d58-e162-465f-a509-2c39f7a97726-delete_snapshot" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:34:29 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0d2c76e1-0169-418c-bdf0-c27060924baf tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Lock "cinder-63421d58-e162-465f-a509-2c39f7a97726-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:34:29 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0d2c76e1-0169-418c-bdf0-c27060924baf tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Acquiring lock "cinder-quobyte-158fa562-e26e-4636-8084-1e74cd38f1c9" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:34:29 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0d2c76e1-0169-418c-bdf0-c27060924baf tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Lock "cinder-quobyte-158fa562-e26e-4636-8084-1e74cd38f1c9" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:34:29 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0d2c76e1-0169-418c-bdf0-c27060924baf tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Acquiring lock "cinder-quobyte-63421d58-e162-465f-a509-2c39f7a97726" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:34:29 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0d2c76e1-0169-418c-bdf0-c27060924baf tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Lock "cinder-quobyte-63421d58-e162-465f-a509-2c39f7a97726" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:34:29 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-0d2c76e1-0169-418c-bdf0-c27060924baf tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Deleting offline snapshot 63421d58-e162-465f-a509-2c39f7a97726 of volume 158fa562-e26e-4636-8084-1e74cd38f1c9 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-0d2c76e1-0169-418c-bdf0-c27060924baf tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] snapshot_file for this snap is: volume-158fa562-e26e-4636-8084-1e74cd38f1c9.63421d58-e162-465f-a509-2c39f7a97726 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:34:30 devstack sudo[96953]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-725b4065-1963-465d-ac62-c39a7d1ceb74 tempest-VolumesTransfersV357Test-2030422637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.900s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-725b4065-1963-465d-ac62-c39a7d1ceb74 tempest-VolumesTransfersV357Test-2030422637 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9b3e7a-0d68-417f-a765-4f0735435091]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0d2c76e1-0169-418c-bdf0-c27060924baf tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9.63421d58-e162-465f-a509-2c39f7a97726 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:30 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-725b4065-1963-465d-ac62-c39a7d1ceb74 tempest-VolumesTransfersV357Test-2030422637 None] Deleted volume successfully. Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-725b4065-1963-465d-ac62-c39a7d1ceb74 tempest-VolumesTransfersV357Test-2030422637 None] Lock "cinder-38af2b34-7d67-4821-9f2d-7d35c689d755-delete_volume" released by "delete_volume" :: held 2.804s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:34:30 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34ffeb0a-a759-4dee-a735-a8b719521c81 1073741824" returned: 0 in 1.126s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34ffeb0a-a759-4dee-a735-a8b719521c81 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:30 devstack sudo[96961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9.63421d58-e162-465f-a509-2c39f7a97726 Jun 04 06:34:30 devstack sudo[96961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:30 devstack sudo[96963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34ffeb0a-a759-4dee-a735-a8b719521c81 Jun 04 06:34:30 devstack sudo[96963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] Flow 'volume_create_manager' (0aa60b07-8b5d-4456-b780-847a641b727a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8450177-158c-4bcb-84e3-9b0a9b3c471d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8450177-158c-4bcb-84e3-9b0a9b3c471d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1808434187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b96e9a90-c18c-4d40-819d-c64bb4522745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310e32d67e1441a499c3efac2ab5e403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:34:30Z,use_quota=True,user_id='1864b66e28624180b1af3a8cf3cd049d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fac18742-ddb8-4262-b5f3-6675264e2db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fac18742-ddb8-4262-b5f3-6675264e2db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (478fa5b4-14a2-498c-95d4-a4ed9f12eae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (478fa5b4-14a2-498c-95d4-a4ed9f12eae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b96e9a90-c18c-4d40-819d-c64bb4522745', 'volume_name': 'volume-b96e9a90-c18c-4d40-819d-c64bb4522745', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a2ebf64-a740-4dd8-9c09-3836f035d35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a2ebf64-a740-4dd8-9c09-3836f035d35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c67c24d-5e25-47c0-afe7-af8851746786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:30 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] Volume b96e9a90-c18c-4d40-819d-c64bb4522745: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b96e9a90-c18c-4d40-819d-c64bb4522745', 'volume_size': 1} Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:34:30 devstack sudo[96961]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0d2c76e1-0169-418c-bdf0-c27060924baf tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9.63421d58-e162-465f-a509-2c39f7a97726" returned: 0 in 0.811s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-0d2c76e1-0169-418c-bdf0-c27060924baf tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-158fa562-e26e-4636-8084-1e74cd38f1c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:34:30 devstack sudo[96963]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34ffeb0a-a759-4dee-a735-a8b719521c81" returned: 0 in 0.696s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] <== create_volume: return (1893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.897s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.479s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1808434187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b96e9a90-c18c-4d40-819d-c64bb4522745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310e32d67e1441a499c3efac2ab5e403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:34:30Z,use_quota=True,user_id='1864b66e28624180b1af3a8cf3cd049d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] Creating volume b96e9a90-c18c-4d40-819d-c64bb4522745 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:34:30 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b96e9a90-c18c-4d40-819d-c64bb4522745 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4ee8f6-97e8-4feb-9d62-c3c1bbc8b6c6]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:34:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0d2c76e1-0169-418c-bdf0-c27060924baf tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:30 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b96e9a90-c18c-4d40-819d-c64bb4522745 1073741824 Jun 04 06:34:30 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:31 devstack cinder-volume[86069]: DEBUG cinder.volume.volume_utils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Attempting download of 6fd2add9-e03b-4114-aa96-77265cdc109f ((None, [{'url': 'file:///opt/stack/data/glance/images/6fd2add9-e03b-4114-aa96-77265cdc109f', 'metadata': {}}])) to volume 34ffeb0a-a759-4dee-a735-a8b719521c81. {{(pid=86069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 04 06:34:31 devstack sudo[96970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9 Jun 04 06:34:31 devstack sudo[96970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:31 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ec5ed1-8fb0-4677-99b2-4a54585e2a98]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:34:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6fd2add9-e03b-4114-aa96-77265cdc109f_yuksg4uy {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:31 devstack sudo[96973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6fd2add9-e03b-4114-aa96-77265cdc109f_yuksg4uy Jun 04 06:34:31 devstack sudo[96973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:31 devstack sudo[96970]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0d2c76e1-0169-418c-bdf0-c27060924baf tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9" returned: 0 in 0.938s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0d2c76e1-0169-418c-bdf0-c27060924baf tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9.63421d58-e162-465f-a509-2c39f7a97726 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:31 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9.63421d58-e162-465f-a509-2c39f7a97726 Jun 04 06:34:31 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:32 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b96e9a90-c18c-4d40-819d-c64bb4522745 1073741824" returned: 0 in 1.102s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:32 devstack sudo[96973]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6fd2add9-e03b-4114-aa96-77265cdc109f_yuksg4uy" returned: 0 in 0.906s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6fd2add9-e03b-4114-aa96-77265cdc109f_yuksg4uy {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b96e9a90-c18c-4d40-819d-c64bb4522745 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:32 devstack sudo[96987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b96e9a90-c18c-4d40-819d-c64bb4522745 Jun 04 06:34:32 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:32 devstack sudo[96986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6fd2add9-e03b-4114-aa96-77265cdc109f_yuksg4uy Jun 04 06:34:32 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:32 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b96e9a90-c18c-4d40-819d-c64bb4522745" returned: 0 in 0.753s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:32 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] <== create_volume: return (1941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:34:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.947s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:34:32 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c67c24d-5e25-47c0-afe7-af8851746786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b96e9a90-c18c-4d40-819d-c64bb4522745', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:32 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (487944c4-33d6-42e1-bcc2-ce8478d09db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:32 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:32 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] Volume volume-b96e9a90-c18c-4d40-819d-c64bb4522745 (b96e9a90-c18c-4d40-819d-c64bb4522745): created successfully Jun 04 06:34:32 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (487944c4-33d6-42e1-bcc2-ce8478d09db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:32 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] Flow 'volume_create_manager' (0aa60b07-8b5d-4456-b780-847a641b727a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:34:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0d2c76e1-0169-418c-bdf0-c27060924baf tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9.63421d58-e162-465f-a509-2c39f7a97726" returned: 0 in 1.047s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0d2c76e1-0169-418c-bdf0-c27060924baf tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9.63421d58-e162-465f-a509-2c39f7a97726 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:32 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-9ad07afc-0147-47c7-96e5-2bc798f459b1 tempest-VolumesTransfersV357Test-1210235123 None] Created volume successfully. Jun 04 06:34:32 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9.63421d58-e162-465f-a509-2c39f7a97726 Jun 04 06:34:32 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:33 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6fd2add9-e03b-4114-aa96-77265cdc109f_yuksg4uy" returned: 1 in 0.969s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6fd2add9-e03b-4114-aa96-77265cdc109f_yuksg4uy' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:34:33 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[2653d48a-0054-47d4-b57e-0702bde3b0ae]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:34:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6fd2add9-e03b-4114-aa96-77265cdc109f_0qu4r6r9devstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:33 devstack sudo[96998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6fd2add9-e03b-4114-aa96-77265cdc109f_0qu4r6r9devstack@QuobyteHD Jun 04 06:34:33 devstack sudo[96998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:33 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0d2c76e1-0169-418c-bdf0-c27060924baf tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9.63421d58-e162-465f-a509-2c39f7a97726" returned: 0 in 0.681s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0d2c76e1-0169-418c-bdf0-c27060924baf tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Lock "cinder-quobyte-63421d58-e162-465f-a509-2c39f7a97726" released by "_delete_snapshot" :: held 3.674s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:34:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0d2c76e1-0169-418c-bdf0-c27060924baf tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Lock "cinder-quobyte-158fa562-e26e-4636-8084-1e74cd38f1c9" released by "delete_snapshot" :: held 3.695s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:34:33 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-0d2c76e1-0169-418c-bdf0-c27060924baf tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Created reservations ['604229b7-7ee1-4b94-a34f-a6fe65331740', '5f78a1c3-45a1-4d21-ace8-d638b0b3cd93', '1387e95b-05f0-40ba-a570-421d9552e4cd', '19b3ab25-03f3-4efe-828a-469fe2bed5b8'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:34:33 devstack sudo[96998]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6fd2add9-e03b-4114-aa96-77265cdc109f_0qu4r6r9devstack@QuobyteHD" returned: 0 in 0.803s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6fd2add9-e03b-4114-aa96-77265cdc109f_0qu4r6r9devstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:33 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-0d2c76e1-0169-418c-bdf0-c27060924baf tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Delete snapshot completed successfully. Jun 04 06:34:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0d2c76e1-0169-418c-bdf0-c27060924baf tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Lock "cinder-63421d58-e162-465f-a509-2c39f7a97726-delete_snapshot" released by "delete_snapshot" :: held 3.951s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:34:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-08debc77-2b31-40fc-88ea-64d862d8d36b tempest-VolumesTransfersV357Test-2030422637 None] Acquiring lock "cinder-b96e9a90-c18c-4d40-819d-c64bb4522745-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:34:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-08debc77-2b31-40fc-88ea-64d862d8d36b tempest-VolumesTransfersV357Test-2030422637 None] Lock "cinder-b96e9a90-c18c-4d40-819d-c64bb4522745-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:34:34 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6fd2add9-e03b-4114-aa96-77265cdc109f_0qu4r6r9devstack@QuobyteHD Jun 04 06:34:34 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-08debc77-2b31-40fc-88ea-64d862d8d36b tempest-VolumesTransfersV357Test-2030422637 None] Acquiring lock "cinder-quobyte-b96e9a90-c18c-4d40-819d-c64bb4522745" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:34:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-08debc77-2b31-40fc-88ea-64d862d8d36b tempest-VolumesTransfersV357Test-2030422637 None] Lock "cinder-quobyte-b96e9a90-c18c-4d40-819d-c64bb4522745" acquired by "delete_volume" :: waited 0.020s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:34:34 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd09ca16-4887-4f4f-bced-6874e49f4100]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:34:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-08debc77-2b31-40fc-88ea-64d862d8d36b tempest-VolumesTransfersV357Test-2030422637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b96e9a90-c18c-4d40-819d-c64bb4522745 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:34 devstack sudo[97011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b96e9a90-c18c-4d40-819d-c64bb4522745 Jun 04 06:34:34 devstack sudo[97011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-8b6407e7-00c4-4179-98e2-50824e31d095 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Acquiring lock "cinder-158fa562-e26e-4636-8084-1e74cd38f1c9-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:34:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-8b6407e7-00c4-4179-98e2-50824e31d095 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Lock "cinder-158fa562-e26e-4636-8084-1e74cd38f1c9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:34:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-8b6407e7-00c4-4179-98e2-50824e31d095 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Acquiring lock "cinder-quobyte-158fa562-e26e-4636-8084-1e74cd38f1c9" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:34:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-8b6407e7-00c4-4179-98e2-50824e31d095 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Lock "cinder-quobyte-158fa562-e26e-4636-8084-1e74cd38f1c9" acquired by "delete_volume" :: waited 0.019s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:34:34 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ca823f-830d-4744-acc0-d58e500c7a3a]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:34:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8b6407e7-00c4-4179-98e2-50824e31d095 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:34 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9 Jun 04 06:34:34 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:34 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6fd2add9-e03b-4114-aa96-77265cdc109f_0qu4r6r9devstack@QuobyteHD" returned: 1 in 0.873s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6fd2add9-e03b-4114-aa96-77265cdc109f_0qu4r6r9devstack@QuobyteHD' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:34:34 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] 6fd2add9-e03b-4114-aa96-77265cdc109f was raw, converting to raw {{(pid=86069) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 04 06:34:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6fd2add9-e03b-4114-aa96-77265cdc109f_0qu4r6r9devstack@QuobyteHD /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34ffeb0a-a759-4dee-a735-a8b719521c81 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:34 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6fd2add9-e03b-4114-aa96-77265cdc109f_0qu4r6r9devstack@QuobyteHD /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34ffeb0a-a759-4dee-a735-a8b719521c81 Jun 04 06:34:34 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:35 devstack sudo[97011]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-08debc77-2b31-40fc-88ea-64d862d8d36b tempest-VolumesTransfersV357Test-2030422637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b96e9a90-c18c-4d40-819d-c64bb4522745" returned: 0 in 0.944s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-08debc77-2b31-40fc-88ea-64d862d8d36b tempest-VolumesTransfersV357Test-2030422637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b96e9a90-c18c-4d40-819d-c64bb4522745 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:35 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b96e9a90-c18c-4d40-819d-c64bb4522745 Jun 04 06:34:35 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:35 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8b6407e7-00c4-4179-98e2-50824e31d095 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9" returned: 0 in 0.906s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8b6407e7-00c4-4179-98e2-50824e31d095 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:35 devstack sudo[97031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9 Jun 04 06:34:35 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:35 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6fd2add9-e03b-4114-aa96-77265cdc109f_0qu4r6r9devstack@QuobyteHD /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34ffeb0a-a759-4dee-a735-a8b719521c81" returned: 0 in 0.899s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:35 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6fd2add9-e03b-4114-aa96-77265cdc109f_0qu4r6r9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34ffeb0a-a759-4dee-a735-a8b719521c81 {{(pid=86069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 06:34:35 devstack cinder-volume[86069]: INFO cinder.image.image_utils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Converted 0.00 MB image at 0.00 MB/s Jun 04 06:34:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34ffeb0a-a759-4dee-a735-a8b719521c81 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:35 devstack sudo[97034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34ffeb0a-a759-4dee-a735-a8b719521c81 1G Jun 04 06:34:35 devstack sudo[97034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:35 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-08debc77-2b31-40fc-88ea-64d862d8d36b tempest-VolumesTransfersV357Test-2030422637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b96e9a90-c18c-4d40-819d-c64bb4522745" returned: 0 in 0.748s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:35 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-08debc77-2b31-40fc-88ea-64d862d8d36b tempest-VolumesTransfersV357Test-2030422637 None] Lock "cinder-quobyte-b96e9a90-c18c-4d40-819d-c64bb4522745" released by "delete_volume" :: held 1.751s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:34:35 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-08debc77-2b31-40fc-88ea-64d862d8d36b tempest-VolumesTransfersV357Test-2030422637 None] Created reservations ['24a45c5f-6483-4e49-8cc2-1beb4e979647', '2ce264ba-8570-4d89-8da7-0eddd9abc170', '8d7bca7d-e43f-4d94-83bf-863b6393b697', 'dbab9ce6-aa7c-4856-a611-9908db2647ea'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:34:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-08debc77-2b31-40fc-88ea-64d862d8d36b tempest-VolumesTransfersV357Test-2030422637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:34:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-08debc77-2b31-40fc-88ea-64d862d8d36b tempest-VolumesTransfersV357Test-2030422637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:34:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-08debc77-2b31-40fc-88ea-64d862d8d36b tempest-VolumesTransfersV357Test-2030422637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:34:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-08debc77-2b31-40fc-88ea-64d862d8d36b tempest-VolumesTransfersV357Test-2030422637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:34:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-08debc77-2b31-40fc-88ea-64d862d8d36b tempest-VolumesTransfersV357Test-2030422637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:34:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-08debc77-2b31-40fc-88ea-64d862d8d36b tempest-VolumesTransfersV357Test-2030422637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:35 devstack sudo[97037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:34:35 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:36 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8b6407e7-00c4-4179-98e2-50824e31d095 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-158fa562-e26e-4636-8084-1e74cd38f1c9" returned: 0 in 0.749s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:36 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-8b6407e7-00c4-4179-98e2-50824e31d095 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Lock "cinder-quobyte-158fa562-e26e-4636-8084-1e74cd38f1c9" released by "delete_volume" :: held 1.730s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:34:36 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-8b6407e7-00c4-4179-98e2-50824e31d095 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Created reservations ['da5e456c-9554-4a26-8ad3-6a97dd3700ea', 'bfe3e4d6-eb8c-40e1-b879-119913614eee', 'd44d5686-bc9a-45be-8b4b-5ef91df833fe', '7b36d589-07e3-452e-b968-768ad9974b80'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:34:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8b6407e7-00c4-4179-98e2-50824e31d095 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:34:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8b6407e7-00c4-4179-98e2-50824e31d095 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:34:36 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-8b6407e7-00c4-4179-98e2-50824e31d095 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:34:36 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-8b6407e7-00c4-4179-98e2-50824e31d095 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:34:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8b6407e7-00c4-4179-98e2-50824e31d095 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:34:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8b6407e7-00c4-4179-98e2-50824e31d095 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:36 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:34:36 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:36 devstack sudo[97034]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34ffeb0a-a759-4dee-a735-a8b719521c81 1G" returned: 0 in 0.832s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:36 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8d41b6-1f31-44df-b2c4-1c2c0f2f561c]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:34:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34ffeb0a-a759-4dee-a735-a8b719521c81 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:36 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34ffeb0a-a759-4dee-a735-a8b719521c81 Jun 04 06:34:36 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:37 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-08debc77-2b31-40fc-88ea-64d862d8d36b tempest-VolumesTransfersV357Test-2030422637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.095s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:37 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-08debc77-2b31-40fc-88ea-64d862d8d36b tempest-VolumesTransfersV357Test-2030422637 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:34:37 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-08debc77-2b31-40fc-88ea-64d862d8d36b tempest-VolumesTransfersV357Test-2030422637 None] Deleted volume successfully. Jun 04 06:34:37 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-08debc77-2b31-40fc-88ea-64d862d8d36b tempest-VolumesTransfersV357Test-2030422637 None] Lock "cinder-b96e9a90-c18c-4d40-819d-c64bb4522745-delete_volume" released by "delete_volume" :: held 3.125s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:34:37 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8b6407e7-00c4-4179-98e2-50824e31d095 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.095s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:37 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-8b6407e7-00c4-4179-98e2-50824e31d095 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:34:37 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-8b6407e7-00c4-4179-98e2-50824e31d095 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Deleted volume successfully. Jun 04 06:34:37 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-8b6407e7-00c4-4179-98e2-50824e31d095 tempest-VolumeSnapshotQuotasNegativeTestJSON-776699813 None] Lock "cinder-158fa562-e26e-4636-8084-1e74cd38f1c9-delete_volume" released by "delete_volume" :: held 3.150s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:34:37 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34ffeb0a-a759-4dee-a735-a8b719521c81" returned: 0 in 1.244s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34ffeb0a-a759-4dee-a735-a8b719521c81 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:37 devstack sudo[97052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34ffeb0a-a759-4dee-a735-a8b719521c81 Jun 04 06:34:37 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:38 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34ffeb0a-a759-4dee-a735-a8b719521c81" returned: 1 in 0.894s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34ffeb0a-a759-4dee-a735-a8b719521c81' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:34:38 devstack cinder-volume[86069]: DEBUG cinder.volume.volume_utils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Downloaded image 6fd2add9-e03b-4114-aa96-77265cdc109f ((None, [{'url': 'file:///opt/stack/data/glance/images/6fd2add9-e03b-4114-aa96-77265cdc109f', 'metadata': {}}])) to volume 34ffeb0a-a759-4dee-a735-a8b719521c81 successfully. {{(pid=86069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 04 06:34:38 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Temporary image 6fd2add9-e03b-4114-aa96-77265cdc109f for user 6db1428b3c0e490d93ec8361a90d6359 is deleted. {{(pid=86069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 04 06:34:38 devstack cinder-volume[86069]: DEBUG cinder.volume.volume_utils [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Marking volume 34ffeb0a-a759-4dee-a735-a8b719521c81 as bootable. {{(pid=86069) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 04 06:34:38 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=92,cinder:INSERT=38,cinder:UPDATE=120,cinder:DELETE=7 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:34:38 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Copying metadata from image 6fd2add9-e03b-4114-aa96-77265cdc109f to 34ffeb0a-a759-4dee-a735-a8b719521c81. {{(pid=86069) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 04 06:34:38 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Creating volume glance metadata for volume 34ffeb0a-a759-4dee-a735-a8b719521c81 backed by image 6fd2add9-e03b-4114-aa96-77265cdc109f with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '6fd2add9-e03b-4114-aa96-77265cdc109f', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '2484e91a0bc5117d0560a30ac41f2592', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86069) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 04 06:34:38 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (019e817c-aaa3-4211-bf20-a0d725897e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34ffeb0a-a759-4dee-a735-a8b719521c81', 'volume_size': 1, 'image_id': '6fd2add9-e03b-4114-aa96-77265cdc109f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6fd2add9-e03b-4114-aa96-77265cdc109f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2484e91a0bc5117d0560a30ac41f2592', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ea2448f8f0fa477c947fb1eed7014355', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a9e19d3f082bf9254bfd2da93e6c4eaa8bbd23e1e45a87a67ca62c02caa8e8f2a725907c9679c9e96ed60d595a214c49025a05e814ef0a1720026821cc784de', 'id': '6fd2add9-e03b-4114-aa96-77265cdc109f', 'created_at': datetime.datetime(2026, 6, 4, 4, 34, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 4, 34, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6fd2add9-e03b-4114-aa96-77265cdc109f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:38 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4138bb95-8633-41c0-9047-0aac9e73c5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:38 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Volume volume-34ffeb0a-a759-4dee-a735-a8b719521c81 (34ffeb0a-a759-4dee-a735-a8b719521c81): created successfully Jun 04 06:34:38 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4138bb95-8633-41c0-9047-0aac9e73c5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:38 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Flow 'volume_create_manager' (bf9a74b0-8c2f-4198-850a-1e4f0b79c64c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:34:38 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-03d996f7-d1ba-440b-8f51-7901fac91c75 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Created volume successfully. Jun 04 06:34:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-b11cc355-37db-4956-b2bf-cfa90dab2529 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Acquiring lock "cinder-34ffeb0a-a759-4dee-a735-a8b719521c81-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:34:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-b11cc355-37db-4956-b2bf-cfa90dab2529 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Lock "cinder-34ffeb0a-a759-4dee-a735-a8b719521c81-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:34:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-b11cc355-37db-4956-b2bf-cfa90dab2529 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Acquiring lock "cinder-quobyte-34ffeb0a-a759-4dee-a735-a8b719521c81" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:34:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-b11cc355-37db-4956-b2bf-cfa90dab2529 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Lock "cinder-quobyte-34ffeb0a-a759-4dee-a735-a8b719521c81" acquired by "delete_volume" :: waited 0.015s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:34:39 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3456c19-4c77-4509-a274-f079c42492ac]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:34:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b11cc355-37db-4956-b2bf-cfa90dab2529 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34ffeb0a-a759-4dee-a735-a8b719521c81 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:39 devstack sudo[97057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34ffeb0a-a759-4dee-a735-a8b719521c81 Jun 04 06:34:39 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:40 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b11cc355-37db-4956-b2bf-cfa90dab2529 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34ffeb0a-a759-4dee-a735-a8b719521c81" returned: 0 in 0.756s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b11cc355-37db-4956-b2bf-cfa90dab2529 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34ffeb0a-a759-4dee-a735-a8b719521c81 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:40 devstack sudo[97061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34ffeb0a-a759-4dee-a735-a8b719521c81 Jun 04 06:34:40 devstack sudo[97061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:41 devstack sudo[97061]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b11cc355-37db-4956-b2bf-cfa90dab2529 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34ffeb0a-a759-4dee-a735-a8b719521c81" returned: 1 in 0.962s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b11cc355-37db-4956-b2bf-cfa90dab2529 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34ffeb0a-a759-4dee-a735-a8b719521c81' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:34:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b11cc355-37db-4956-b2bf-cfa90dab2529 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34ffeb0a-a759-4dee-a735-a8b719521c81 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:41 devstack sudo[97067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34ffeb0a-a759-4dee-a735-a8b719521c81 Jun 04 06:34:41 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:42 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b11cc355-37db-4956-b2bf-cfa90dab2529 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34ffeb0a-a759-4dee-a735-a8b719521c81" returned: 0 in 0.696s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:42 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-b11cc355-37db-4956-b2bf-cfa90dab2529 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Lock "cinder-quobyte-34ffeb0a-a759-4dee-a735-a8b719521c81" released by "delete_volume" :: held 2.509s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:34:42 devstack cinder-volume[86069]: WARNING cinder.quota [None req-b11cc355-37db-4956-b2bf-cfa90dab2529 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 04 06:34:42 devstack cinder-volume[86069]: WARNING cinder.quota [None req-b11cc355-37db-4956-b2bf-cfa90dab2529 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 04 06:34:42 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-b11cc355-37db-4956-b2bf-cfa90dab2529 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Created reservations ['cd4e1a49-3079-4bfc-bc5b-2660444ef57f', '0609ada7-a1c4-4739-b8a7-f032281e1be5', 'a31af6a3-d206-4015-8d00-44e9746581b6', '7a05ef1e-14c3-40ad-aaee-181e4f40e7a5'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:34:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-b11cc355-37db-4956-b2bf-cfa90dab2529 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:34:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-b11cc355-37db-4956-b2bf-cfa90dab2529 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:34:42 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-b11cc355-37db-4956-b2bf-cfa90dab2529 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:34:42 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-b11cc355-37db-4956-b2bf-cfa90dab2529 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:34:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-b11cc355-37db-4956-b2bf-cfa90dab2529 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:34:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b11cc355-37db-4956-b2bf-cfa90dab2529 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:42 devstack sudo[97070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:34:42 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:43 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b11cc355-37db-4956-b2bf-cfa90dab2529 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.948s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:43 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-b11cc355-37db-4956-b2bf-cfa90dab2529 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:34:43 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-b11cc355-37db-4956-b2bf-cfa90dab2529 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Deleted volume successfully. Jun 04 06:34:43 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-b11cc355-37db-4956-b2bf-cfa90dab2529 tempest-VolumeAndVolumeTypeFromImageTest-1629393939 None] Lock "cinder-34ffeb0a-a759-4dee-a735-a8b719521c81-delete_volume" released by "delete_volume" :: held 3.772s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] Flow 'volume_create_manager' (07cd20dd-940b-45db-ad7b-89bd04861615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fb6d38b-1ee0-4ba7-8360-f5aea774b496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fb6d38b-1ee0-4ba7-8360-f5aea774b496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1602586668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7bd72ec-dba8-4e1a-97e3-2857cb73aebc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1df8ca80c053453c954aa7148e673f5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:34:47Z,use_quota=True,user_id='ffb916f2203040cc8e29affd20556fce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ab39038-5617-4ded-ad13-3f3a2a75396d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ab39038-5617-4ded-ad13-3f3a2a75396d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57f206af-a316-4367-b78f-ce67d0167c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57f206af-a316-4367-b78f-ce67d0167c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7bd72ec-dba8-4e1a-97e3-2857cb73aebc', 'volume_name': 'volume-d7bd72ec-dba8-4e1a-97e3-2857cb73aebc', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f3fb9ac-0c73-4a99-b8d0-fc53f54da391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f3fb9ac-0c73-4a99-b8d0-fc53f54da391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ace5d4-674d-4d61-8162-72dec068c0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:47 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] Volume d7bd72ec-dba8-4e1a-97e3-2857cb73aebc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7bd72ec-dba8-4e1a-97e3-2857cb73aebc', 'volume_size': 1} Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1602586668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7bd72ec-dba8-4e1a-97e3-2857cb73aebc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1df8ca80c053453c954aa7148e673f5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:34:47Z,use_quota=True,user_id='ffb916f2203040cc8e29affd20556fce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] Creating volume d7bd72ec-dba8-4e1a-97e3-2857cb73aebc {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:34:47 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d7bd72ec-dba8-4e1a-97e3-2857cb73aebc 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:47 devstack sudo[97074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d7bd72ec-dba8-4e1a-97e3-2857cb73aebc 1073741824 Jun 04 06:34:47 devstack sudo[97074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Flow 'volume_create_manager' (4fb6260b-ae4c-4a75-9179-02eff35745be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfc33875-c416-4441-a28d-d174d785d4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfc33875-c416-4441-a28d-d174d785d4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-582798328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2aace28-7230-43af-8f75-e46b81558993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faf5bc28773b40dabbaf3526e03f0fe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:34:47Z,use_quota=True,user_id='013989303efb4d1bb34df6169bfd4dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1f71611-0c8b-4e8f-8a3e-fcfaffaea86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1f71611-0c8b-4e8f-8a3e-fcfaffaea86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25da6730-4c3f-4222-a6c6-daa5ee5d85d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG cinder.image.glance [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Creating Keystone auth plugin from conf {{(pid=86069) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25da6730-4c3f-4222-a6c6-daa5ee5d85d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a2aace28-7230-43af-8f75-e46b81558993', 'volume_name': 'volume-a2aace28-7230-43af-8f75-e46b81558993', 'volume_size': 1, 'image_id': '356a113c-ac9f-4c32-896c-2ab17fc4b371', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/356a113c-ac9f-4c32-896c-2ab17fc4b371', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73b4c085134a4115abd513b2dd9d6c91', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '356a113c-ac9f-4c32-896c-2ab17fc4b371', 'created_at': datetime.datetime(2026, 6, 4, 4, 19, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 4, 19, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/356a113c-ac9f-4c32-896c-2ab17fc4b371/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56b32779-0a55-4fe0-8dfd-b7f6287b5616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56b32779-0a55-4fe0-8dfd-b7f6287b5616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5037dfe2-6a5d-4851-9e22-c7088427f14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:47 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Volume a2aace28-7230-43af-8f75-e46b81558993: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a2aace28-7230-43af-8f75-e46b81558993', 'volume_size': 1, 'image_id': '356a113c-ac9f-4c32-896c-2ab17fc4b371', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/356a113c-ac9f-4c32-896c-2ab17fc4b371', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73b4c085134a4115abd513b2dd9d6c91', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '356a113c-ac9f-4c32-896c-2ab17fc4b371', 'created_at': datetime.datetime(2026, 6, 4, 4, 19, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 4, 19, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/356a113c-ac9f-4c32-896c-2ab17fc4b371/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 04 06:34:47 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Trying to clone a2aace28-7230-43af-8f75-e46b81558993 from image 356a113c-ac9f-4c32-896c-2ab17fc4b371 at location (None, [{'url': 'file:///opt/stack/data/glance/images/356a113c-ac9f-4c32-896c-2ab17fc4b371', 'metadata': {}}]). {{(pid=86069) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 04 06:34:48 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_w4fzv8jfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86069) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 04 06:34:48 devstack cinder-volume[86069]: INFO cinder.image.image_utils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Image download 20.69 MB at 20.69 MB/s Jun 04 06:34:48 devstack sudo[97074]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d7bd72ec-dba8-4e1a-97e3-2857cb73aebc 1073741824" returned: 0 in 1.266s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:48 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[8597f1a4-5e4e-4092-9e6a-714efd3a4862]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:34:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_w4fzv8jfdevstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d7bd72ec-dba8-4e1a-97e3-2857cb73aebc {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:48 devstack sudo[97081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d7bd72ec-dba8-4e1a-97e3-2857cb73aebc Jun 04 06:34:48 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:48 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_w4fzv8jfdevstack@QuobyteHD Jun 04 06:34:48 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:49 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d7bd72ec-dba8-4e1a-97e3-2857cb73aebc" returned: 0 in 0.764s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:49 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] <== create_volume: return (2114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:34:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.116s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:34:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ace5d4-674d-4d61-8162-72dec068c0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7bd72ec-dba8-4e1a-97e3-2857cb73aebc', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2da5cd5e-d6b1-4421-b6ea-267f72819b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:49 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] Volume volume-d7bd72ec-dba8-4e1a-97e3-2857cb73aebc (d7bd72ec-dba8-4e1a-97e3-2857cb73aebc): created successfully Jun 04 06:34:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2da5cd5e-d6b1-4421-b6ea-267f72819b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] Flow 'volume_create_manager' (07cd20dd-940b-45db-ad7b-89bd04861615) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:34:49 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-a778829a-7d7c-4c66-bbcb-e45aaaa5fa49 tempest-VolumesListTestJSON-1822522978 None] Created volume successfully. Jun 04 06:34:49 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_w4fzv8jfdevstack@QuobyteHD" returned: 0 in 0.942s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:49 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Temporary image 356a113c-ac9f-4c32-896c-2ab17fc4b371 is fetched for user 013989303efb4d1bb34df6169bfd4dca. {{(pid=86069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 04 06:34:49 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf49ad1-59e4-4755-8d92-b6ae2f680405]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:34:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_w4fzv8jfdevstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:49 devstack sudo[97091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_w4fzv8jfdevstack@QuobyteHD Jun 04 06:34:49 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:50 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_w4fzv8jfdevstack@QuobyteHD" returned: 0 in 0.832s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:34:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:34:50 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-582798328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2aace28-7230-43af-8f75-e46b81558993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faf5bc28773b40dabbaf3526e03f0fe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:34:47Z,use_quota=True,user_id='013989303efb4d1bb34df6169bfd4dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:34:50 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Creating volume a2aace28-7230-43af-8f75-e46b81558993 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:34:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:34:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:34:50 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:34:50 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:34:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:34:50 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:34:50 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:34:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a2aace28-7230-43af-8f75-e46b81558993 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:50 devstack sudo[97097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a2aace28-7230-43af-8f75-e46b81558993 1073741824 Jun 04 06:34:50 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:51 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:34:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] Flow 'volume_create_manager' (f0fa3c07-dd88-40e1-a5c0-50c6df30b33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:34:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39bf41c1-7c22-441f-89f0-3b30b1d4e6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39bf41c1-7c22-441f-89f0-3b30b1d4e6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-347962266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5912bbf7-4067-4bdf-b4c9-2d96c13a96c8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1df8ca80c053453c954aa7148e673f5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:34:51Z,use_quota=True,user_id='ffb916f2203040cc8e29affd20556fce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f744d4f6-36ed-4952-b6f7-deff1e89ab75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f744d4f6-36ed-4952-b6f7-deff1e89ab75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4146a082-68cc-44d1-8179-66d432cc6c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4146a082-68cc-44d1-8179-66d432cc6c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5912bbf7-4067-4bdf-b4c9-2d96c13a96c8', 'volume_name': 'volume-5912bbf7-4067-4bdf-b4c9-2d96c13a96c8', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e962c15-ab3f-49c6-8a1a-d4085387a510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e962c15-ab3f-49c6-8a1a-d4085387a510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc3555d7-f896-41c7-8849-bc668f210210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:51 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] Volume 5912bbf7-4067-4bdf-b4c9-2d96c13a96c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5912bbf7-4067-4bdf-b4c9-2d96c13a96c8', 'volume_size': 1} Jun 04 06:34:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:34:51 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a2aace28-7230-43af-8f75-e46b81558993 1073741824" returned: 0 in 0.877s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a2aace28-7230-43af-8f75-e46b81558993 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:51 devstack sudo[97103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a2aace28-7230-43af-8f75-e46b81558993 Jun 04 06:34:51 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:52 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a2aace28-7230-43af-8f75-e46b81558993" returned: 0 in 0.643s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:52 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:34:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:34:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.874s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:34:52 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-347962266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5912bbf7-4067-4bdf-b4c9-2d96c13a96c8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1df8ca80c053453c954aa7148e673f5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:34:51Z,use_quota=True,user_id='ffb916f2203040cc8e29affd20556fce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:34:52 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] Creating volume 5912bbf7-4067-4bdf-b4c9-2d96c13a96c8 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:34:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:34:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:34:52 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:34:52 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:34:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:34:52 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:34:52 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:34:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5912bbf7-4067-4bdf-b4c9-2d96c13a96c8 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:52 devstack sudo[97106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5912bbf7-4067-4bdf-b4c9-2d96c13a96c8 1073741824 Jun 04 06:34:52 devstack sudo[97106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:52 devstack cinder-volume[86069]: DEBUG cinder.volume.volume_utils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Attempting download of 356a113c-ac9f-4c32-896c-2ab17fc4b371 ((None, [{'url': 'file:///opt/stack/data/glance/images/356a113c-ac9f-4c32-896c-2ab17fc4b371', 'metadata': {}}])) to volume a2aace28-7230-43af-8f75-e46b81558993. {{(pid=86069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 04 06:34:52 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb42af54-964c-4b3e-8f96-36962a93445b]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:34:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_356a113c-ac9f-4c32-896c-2ab17fc4b371_1kk2228b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:52 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_356a113c-ac9f-4c32-896c-2ab17fc4b371_1kk2228b Jun 04 06:34:52 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:52 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:34:52 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Flow 'volume_create_manager' (82feae55-84fe-42ba-afd9-d28de33c63d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:34:52 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d781363a-9e0b-47e1-89b5-c6a89784cb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:52 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d781363a-9e0b-47e1-89b5-c6a89784cb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea9f5036-7618-4d24-96b7-eea1e700938b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc943de804aa401d90abcc9aa6623fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:34:52Z,use_quota=True,user_id='670af691097640e39c091fc77ecae8a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:52 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2b4b781-280f-4c3e-9cc2-514564b0c822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:52 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2b4b781-280f-4c3e-9cc2-514564b0c822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:52 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21f56ac-dc22-4f03-8056-09bd6801f7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:52 devstack cinder-volume[86069]: DEBUG cinder.image.glance [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Creating Keystone auth plugin from conf {{(pid=86069) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 04 06:34:52 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21f56ac-dc22-4f03-8056-09bd6801f7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ea9f5036-7618-4d24-96b7-eea1e700938b', 'volume_name': 'volume-ea9f5036-7618-4d24-96b7-eea1e700938b', 'volume_size': 1, 'image_id': '6e49cabf-e56a-45ed-8e4a-906cf2313fd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e49cabf-e56a-45ed-8e4a-906cf2313fd4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '192d0fe3324e2ac771e8705fc73cb801', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dc943de804aa401d90abcc9aa6623fd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0586d1948e37b79d9b38e2e97ebfbd15234e76475a6a65abda72db6fe579b93ced8678271418c50328e6fb89f5fe7252aaf1040aa6fa26ef04e9583578eef57b', 'id': '6e49cabf-e56a-45ed-8e4a-906cf2313fd4', 'created_at': datetime.datetime(2026, 6, 4, 4, 34, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 4, 34, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e49cabf-e56a-45ed-8e4a-906cf2313fd4/file', 'properties': {}}, 'image_service': }' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:52 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c4c43f-a01f-4569-b2cc-56f08fe75b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:52 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c4c43f-a01f-4569-b2cc-56f08fe75b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:52 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b4ba9a3-c9c5-4392-b239-b25000d0e8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:52 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Volume ea9f5036-7618-4d24-96b7-eea1e700938b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ea9f5036-7618-4d24-96b7-eea1e700938b', 'volume_size': 1, 'image_id': '6e49cabf-e56a-45ed-8e4a-906cf2313fd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e49cabf-e56a-45ed-8e4a-906cf2313fd4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '192d0fe3324e2ac771e8705fc73cb801', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dc943de804aa401d90abcc9aa6623fd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0586d1948e37b79d9b38e2e97ebfbd15234e76475a6a65abda72db6fe579b93ced8678271418c50328e6fb89f5fe7252aaf1040aa6fa26ef04e9583578eef57b', 'id': '6e49cabf-e56a-45ed-8e4a-906cf2313fd4', 'created_at': datetime.datetime(2026, 6, 4, 4, 34, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 4, 34, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e49cabf-e56a-45ed-8e4a-906cf2313fd4/file', 'properties': {}}, 'image_service': } Jun 04 06:34:52 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Trying to clone ea9f5036-7618-4d24-96b7-eea1e700938b from image 6e49cabf-e56a-45ed-8e4a-906cf2313fd4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6e49cabf-e56a-45ed-8e4a-906cf2313fd4', 'metadata': {}}]). {{(pid=86069) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 04 06:34:52 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_356a113c-ac9f-4c32-896c-2ab17fc4b371_1kk2228b" returned: 0 in 0.795s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_356a113c-ac9f-4c32-896c-2ab17fc4b371_1kk2228b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:52 devstack sudo[97106]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5912bbf7-4067-4bdf-b4c9-2d96c13a96c8 1073741824" returned: 0 in 0.941s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:53 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6e49cabf-e56a-45ed-8e4a-906cf2313fd4_vmhucfzpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86069) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 04 06:34:53 devstack cinder-volume[86069]: INFO cinder.image.image_utils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Image download 0.00 MB at 0.00 MB/s Jun 04 06:34:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5912bbf7-4067-4bdf-b4c9-2d96c13a96c8 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:53 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8171fb-a1ed-432c-9e40-3843f3d072dc]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:34:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e49cabf-e56a-45ed-8e4a-906cf2313fd4_vmhucfzpdevstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:53 devstack sudo[97117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5912bbf7-4067-4bdf-b4c9-2d96c13a96c8 Jun 04 06:34:53 devstack sudo[97117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:53 devstack sudo[97116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_356a113c-ac9f-4c32-896c-2ab17fc4b371_1kk2228b Jun 04 06:34:53 devstack sudo[97116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:53 devstack sudo[97118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e49cabf-e56a-45ed-8e4a-906cf2313fd4_vmhucfzpdevstack@QuobyteHD Jun 04 06:34:53 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:53 devstack sudo[97117]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5912bbf7-4067-4bdf-b4c9-2d96c13a96c8" returned: 0 in 0.613s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:53 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:34:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:34:53 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc3555d7-f896-41c7-8849-bc668f210210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5912bbf7-4067-4bdf-b4c9-2d96c13a96c8', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:53 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbbd0cac-cccb-4a5b-be44-cbb86adb84c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:53 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] Volume volume-5912bbf7-4067-4bdf-b4c9-2d96c13a96c8 (5912bbf7-4067-4bdf-b4c9-2d96c13a96c8): created successfully Jun 04 06:34:53 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbbd0cac-cccb-4a5b-be44-cbb86adb84c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:53 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] Flow 'volume_create_manager' (f0fa3c07-dd88-40e1-a5c0-50c6df30b33c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:34:53 devstack sudo[97116]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_356a113c-ac9f-4c32-896c-2ab17fc4b371_1kk2228b" returned: 1 in 0.755s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_356a113c-ac9f-4c32-896c-2ab17fc4b371_1kk2228b' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:34:53 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6827537-67fc-4ac9-b8cf-a2f202e0f715]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:34:53 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-92db5e46-9d4f-43e9-925a-3e510558e46d tempest-VolumesListTestJSON-1822522978 None] Created volume successfully. Jun 04 06:34:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_w4fzv8jfdevstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:53 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e49cabf-e56a-45ed-8e4a-906cf2313fd4_vmhucfzpdevstack@QuobyteHD" returned: 0 in 0.705s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e49cabf-e56a-45ed-8e4a-906cf2313fd4_vmhucfzpdevstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:53 devstack sudo[97127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_w4fzv8jfdevstack@QuobyteHD Jun 04 06:34:53 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:53 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e49cabf-e56a-45ed-8e4a-906cf2313fd4_vmhucfzpdevstack@QuobyteHD Jun 04 06:34:53 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:54 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_w4fzv8jfdevstack@QuobyteHD" returned: 0 in 0.740s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:54 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] 356a113c-ac9f-4c32-896c-2ab17fc4b371 was qcow2, converting to raw {{(pid=86069) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 04 06:34:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_w4fzv8jfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a2aace28-7230-43af-8f75-e46b81558993 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:54 devstack sudo[97138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_w4fzv8jfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a2aace28-7230-43af-8f75-e46b81558993 Jun 04 06:34:54 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:54 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e49cabf-e56a-45ed-8e4a-906cf2313fd4_vmhucfzpdevstack@QuobyteHD" returned: 1 in 0.807s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e49cabf-e56a-45ed-8e4a-906cf2313fd4_vmhucfzpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:34:54 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Temporary image 6e49cabf-e56a-45ed-8e4a-906cf2313fd4 is fetched for user 670af691097640e39c091fc77ecae8a3. {{(pid=86069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 04 06:34:54 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5999e1-380f-475b-becb-0bb63fd63304]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:34:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e49cabf-e56a-45ed-8e4a-906cf2313fd4_vmhucfzpdevstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:54 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e49cabf-e56a-45ed-8e4a-906cf2313fd4_vmhucfzpdevstack@QuobyteHD Jun 04 06:34:54 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:54 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:34:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] Flow 'volume_create_manager' (21ddd50a-6243-47ec-b2f7-88a6aae1961b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:34:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6adee189-d40b-471e-b170-0ad77755707d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6adee189-d40b-471e-b170-0ad77755707d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1103277289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba2e311-c4a3-4517-9426-ae764e292bd5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1df8ca80c053453c954aa7148e673f5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:34:55Z,use_quota=True,user_id='ffb916f2203040cc8e29affd20556fce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96d69558-3027-4d3d-8f55-5dd12aa3ff70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96d69558-3027-4d3d-8f55-5dd12aa3ff70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c853722d-b03d-4355-a93e-aa4d7630416e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c853722d-b03d-4355-a93e-aa4d7630416e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bba2e311-c4a3-4517-9426-ae764e292bd5', 'volume_name': 'volume-bba2e311-c4a3-4517-9426-ae764e292bd5', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (703c2a5c-d99b-4082-8d40-e274aede4a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (703c2a5c-d99b-4082-8d40-e274aede4a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1aa0b7f-444d-4b6c-88de-583bcd4a57da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:54 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] Volume bba2e311-c4a3-4517-9426-ae764e292bd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bba2e311-c4a3-4517-9426-ae764e292bd5', 'volume_size': 1} Jun 04 06:34:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:34:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:34:54 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1103277289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba2e311-c4a3-4517-9426-ae764e292bd5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1df8ca80c053453c954aa7148e673f5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:34:55Z,use_quota=True,user_id='ffb916f2203040cc8e29affd20556fce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:34:54 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] Creating volume bba2e311-c4a3-4517-9426-ae764e292bd5 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:34:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:34:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:34:54 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:34:54 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:34:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:34:54 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:34:54 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:34:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-bba2e311-c4a3-4517-9426-ae764e292bd5 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:55 devstack sudo[97144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-bba2e311-c4a3-4517-9426-ae764e292bd5 1073741824 Jun 04 06:34:55 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:55 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e49cabf-e56a-45ed-8e4a-906cf2313fd4_vmhucfzpdevstack@QuobyteHD" returned: 0 in 1.246s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e49cabf-e56a-45ed-8e4a-906cf2313fd4_vmhucfzpdevstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:56 devstack sudo[97158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e49cabf-e56a-45ed-8e4a-906cf2313fd4_vmhucfzpdevstack@QuobyteHD Jun 04 06:34:56 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:56 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-bba2e311-c4a3-4517-9426-ae764e292bd5 1073741824" returned: 0 in 1.256s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-bba2e311-c4a3-4517-9426-ae764e292bd5 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:56 devstack sudo[97163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-bba2e311-c4a3-4517-9426-ae764e292bd5 Jun 04 06:34:56 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:56 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e49cabf-e56a-45ed-8e4a-906cf2313fd4_vmhucfzpdevstack@QuobyteHD" returned: 1 in 0.929s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e49cabf-e56a-45ed-8e4a-906cf2313fd4_vmhucfzpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:34:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:34:57 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-bba2e311-c4a3-4517-9426-ae764e292bd5" returned: 0 in 0.882s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:57 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] <== create_volume: return (2195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:34:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.197s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:34:57 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.299s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:34:57 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea9f5036-7618-4d24-96b7-eea1e700938b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc943de804aa401d90abcc9aa6623fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:34:52Z,use_quota=True,user_id='670af691097640e39c091fc77ecae8a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:34:57 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Creating volume ea9f5036-7618-4d24-96b7-eea1e700938b {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:34:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:34:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:34:57 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:34:57 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:34:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:34:57 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:34:57 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:34:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ea9f5036-7618-4d24-96b7-eea1e700938b 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_w4fzv8jfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a2aace28-7230-43af-8f75-e46b81558993" returned: 0 in 2.700s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:57 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_w4fzv8jfdevstack@QuobyteHD, size 112.00 MB, duration 2.70 sec, destination /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a2aace28-7230-43af-8f75-e46b81558993 {{(pid=86069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 06:34:57 devstack cinder-volume[86069]: INFO cinder.image.image_utils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Converted 112.00 MB image at 41.44 MB/s Jun 04 06:34:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a2aace28-7230-43af-8f75-e46b81558993 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:57 devstack sudo[97184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ea9f5036-7618-4d24-96b7-eea1e700938b 1073741824 Jun 04 06:34:57 devstack sudo[97184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:57 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a2aace28-7230-43af-8f75-e46b81558993 1G Jun 04 06:34:57 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1aa0b7f-444d-4b6c-88de-583bcd4a57da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bba2e311-c4a3-4517-9426-ae764e292bd5', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (760472b9-4513-4b89-9b71-c237afb3ab30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:57 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] Volume volume-bba2e311-c4a3-4517-9426-ae764e292bd5 (bba2e311-c4a3-4517-9426-ae764e292bd5): created successfully Jun 04 06:34:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (760472b9-4513-4b89-9b71-c237afb3ab30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] Flow 'volume_create_manager' (21ddd50a-6243-47ec-b2f7-88a6aae1961b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:34:57 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-dcf8d6a4-5a69-4ced-ba38-b2d96e7098d9 tempest-VolumesListTestJSON-1822522978 None] Created volume successfully. Jun 04 06:34:57 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a2aace28-7230-43af-8f75-e46b81558993 1G" returned: 0 in 0.674s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:57 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda173cc-03d2-451b-bd76-e9d9ce5aa4b6]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:34:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a2aace28-7230-43af-8f75-e46b81558993 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:58 devstack sudo[97184]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ea9f5036-7618-4d24-96b7-eea1e700938b 1073741824" returned: 0 in 0.846s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ea9f5036-7618-4d24-96b7-eea1e700938b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:58 devstack sudo[97195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a2aace28-7230-43af-8f75-e46b81558993 Jun 04 06:34:58 devstack sudo[97195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:58 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ea9f5036-7618-4d24-96b7-eea1e700938b Jun 04 06:34:58 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:58 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ea9f5036-7618-4d24-96b7-eea1e700938b" returned: 0 in 0.675s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:58 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:34:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:34:58 devstack sudo[97195]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a2aace28-7230-43af-8f75-e46b81558993" returned: 0 in 0.854s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a2aace28-7230-43af-8f75-e46b81558993 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:58 devstack cinder-volume[86069]: DEBUG cinder.volume.volume_utils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Attempting download of 6e49cabf-e56a-45ed-8e4a-906cf2313fd4 ((None, [{'url': 'file:///opt/stack/data/glance/images/6e49cabf-e56a-45ed-8e4a-906cf2313fd4', 'metadata': {}}])) to volume ea9f5036-7618-4d24-96b7-eea1e700938b. {{(pid=86069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 04 06:34:58 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[828cb284-371b-4a7e-a8a4-fe11638434fc]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:34:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e49cabf-e56a-45ed-8e4a-906cf2313fd4__skey46f {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:58 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a2aace28-7230-43af-8f75-e46b81558993 Jun 04 06:34:58 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:58 devstack sudo[97203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e49cabf-e56a-45ed-8e4a-906cf2313fd4__skey46f Jun 04 06:34:58 devstack sudo[97203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:59 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a2aace28-7230-43af-8f75-e46b81558993" returned: 1 in 0.810s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a2aace28-7230-43af-8f75-e46b81558993' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:34:59 devstack cinder-volume[86069]: DEBUG cinder.volume.volume_utils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Downloaded image 356a113c-ac9f-4c32-896c-2ab17fc4b371 ((None, [{'url': 'file:///opt/stack/data/glance/images/356a113c-ac9f-4c32-896c-2ab17fc4b371', 'metadata': {}}])) to volume a2aace28-7230-43af-8f75-e46b81558993 successfully. {{(pid=86069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 04 06:34:59 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Temporary image 356a113c-ac9f-4c32-896c-2ab17fc4b371 for user 013989303efb4d1bb34df6169bfd4dca is deleted. {{(pid=86069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 04 06:34:59 devstack cinder-volume[86069]: DEBUG cinder.volume.volume_utils [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Marking volume a2aace28-7230-43af-8f75-e46b81558993 as bootable. {{(pid=86069) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 04 06:34:59 devstack sudo[97203]: pam_unix(sudo:session): session closed for user root Jun 04 06:34:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e49cabf-e56a-45ed-8e4a-906cf2313fd4__skey46f" returned: 0 in 0.765s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:34:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e49cabf-e56a-45ed-8e4a-906cf2313fd4__skey46f {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:34:59 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Copying metadata from image 356a113c-ac9f-4c32-896c-2ab17fc4b371 to a2aace28-7230-43af-8f75-e46b81558993. {{(pid=86069) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 04 06:34:59 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Creating volume glance metadata for volume a2aace28-7230-43af-8f75-e46b81558993 backed by image 356a113c-ac9f-4c32-896c-2ab17fc4b371 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '356a113c-ac9f-4c32-896c-2ab17fc4b371', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86069) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 04 06:34:59 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5037dfe2-6a5d-4851-9e22-c7088427f14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2aace28-7230-43af-8f75-e46b81558993', 'volume_size': 1, 'image_id': '356a113c-ac9f-4c32-896c-2ab17fc4b371', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/356a113c-ac9f-4c32-896c-2ab17fc4b371', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73b4c085134a4115abd513b2dd9d6c91', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '356a113c-ac9f-4c32-896c-2ab17fc4b371', 'created_at': datetime.datetime(2026, 6, 4, 4, 19, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 4, 19, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/356a113c-ac9f-4c32-896c-2ab17fc4b371/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:59 devstack sudo[97211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e49cabf-e56a-45ed-8e4a-906cf2313fd4__skey46f Jun 04 06:34:59 devstack sudo[97211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:34:59 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (807d4ded-1c1a-4697-893d-037cdeaf34fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:34:59 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Volume volume-a2aace28-7230-43af-8f75-e46b81558993 (a2aace28-7230-43af-8f75-e46b81558993): created successfully Jun 04 06:34:59 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (807d4ded-1c1a-4697-893d-037cdeaf34fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:34:59 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Flow 'volume_create_manager' (4fb6260b-ae4c-4a75-9179-02eff35745be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:34:59 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-bd555553-f0d8-4e50-b5da-d145970a93bc tempest-VolumesImageMetadata-654496294 None] Created volume successfully. Jun 04 06:35:00 devstack sudo[97211]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e49cabf-e56a-45ed-8e4a-906cf2313fd4__skey46f" returned: 1 in 0.731s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e49cabf-e56a-45ed-8e4a-906cf2313fd4__skey46f' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:35:00 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a3cd19-4220-4bfd-871e-9734fa72a0f4]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:35:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e49cabf-e56a-45ed-8e4a-906cf2313fd4_vmhucfzpdevstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:00 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e49cabf-e56a-45ed-8e4a-906cf2313fd4_vmhucfzpdevstack@QuobyteHD Jun 04 06:35:00 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:00 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ca812684-98b9-4c32-9d96-8dd61ecc6efa tempest-VolumesListTestJSON-1822522978 None] Acquiring lock "cinder-bba2e311-c4a3-4517-9426-ae764e292bd5-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:35:01 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ca812684-98b9-4c32-9d96-8dd61ecc6efa tempest-VolumesListTestJSON-1822522978 None] Lock "cinder-bba2e311-c4a3-4517-9426-ae764e292bd5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:35:01 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7f08bfc0-7891-4b89-81bc-218d7d4f049a tempest-VolumesImageMetadata-654496294 None] Acquiring lock "cinder-a2aace28-7230-43af-8f75-e46b81558993-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:35:01 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ca812684-98b9-4c32-9d96-8dd61ecc6efa tempest-VolumesListTestJSON-1822522978 None] Acquiring lock "cinder-quobyte-bba2e311-c4a3-4517-9426-ae764e292bd5" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:35:01 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7f08bfc0-7891-4b89-81bc-218d7d4f049a tempest-VolumesImageMetadata-654496294 None] Lock "cinder-a2aace28-7230-43af-8f75-e46b81558993-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:35:01 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ca812684-98b9-4c32-9d96-8dd61ecc6efa tempest-VolumesListTestJSON-1822522978 None] Lock "cinder-quobyte-bba2e311-c4a3-4517-9426-ae764e292bd5" acquired by "delete_volume" :: waited 0.039s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:35:01 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:01 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[818dd051-a836-4382-8641-408569af7701]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:35:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ca812684-98b9-4c32-9d96-8dd61ecc6efa tempest-VolumesListTestJSON-1822522978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-bba2e311-c4a3-4517-9426-ae764e292bd5 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e49cabf-e56a-45ed-8e4a-906cf2313fd4_vmhucfzpdevstack@QuobyteHD" returned: 0 in 0.874s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e49cabf-e56a-45ed-8e4a-906cf2313fd4_vmhucfzpdevstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:01 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7f08bfc0-7891-4b89-81bc-218d7d4f049a tempest-VolumesImageMetadata-654496294 None] Acquiring lock "cinder-quobyte-a2aace28-7230-43af-8f75-e46b81558993" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:35:01 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7f08bfc0-7891-4b89-81bc-218d7d4f049a tempest-VolumesImageMetadata-654496294 None] Lock "cinder-quobyte-a2aace28-7230-43af-8f75-e46b81558993" acquired by "delete_volume" :: waited 0.019s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:35:01 devstack sudo[97224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-bba2e311-c4a3-4517-9426-ae764e292bd5 Jun 04 06:35:01 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:01 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[096d6dd3-c013-45fa-92db-1189a9094a36]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:35:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7f08bfc0-7891-4b89-81bc-218d7d4f049a tempest-VolumesImageMetadata-654496294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a2aace28-7230-43af-8f75-e46b81558993 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:01 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e49cabf-e56a-45ed-8e4a-906cf2313fd4_vmhucfzpdevstack@QuobyteHD Jun 04 06:35:01 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:01 devstack sudo[97229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a2aace28-7230-43af-8f75-e46b81558993 Jun 04 06:35:01 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:01 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e49cabf-e56a-45ed-8e4a-906cf2313fd4_vmhucfzpdevstack@QuobyteHD" returned: 1 in 0.723s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e49cabf-e56a-45ed-8e4a-906cf2313fd4_vmhucfzpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:35:01 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] 6e49cabf-e56a-45ed-8e4a-906cf2313fd4 was raw, converting to raw {{(pid=86069) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 04 06:35:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6e49cabf-e56a-45ed-8e4a-906cf2313fd4_vmhucfzpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ea9f5036-7618-4d24-96b7-eea1e700938b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:01 devstack sudo[97239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6e49cabf-e56a-45ed-8e4a-906cf2313fd4_vmhucfzpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ea9f5036-7618-4d24-96b7-eea1e700938b Jun 04 06:35:01 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:02 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ca812684-98b9-4c32-9d96-8dd61ecc6efa tempest-VolumesListTestJSON-1822522978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-bba2e311-c4a3-4517-9426-ae764e292bd5" returned: 0 in 0.819s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ca812684-98b9-4c32-9d96-8dd61ecc6efa tempest-VolumesListTestJSON-1822522978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-bba2e311-c4a3-4517-9426-ae764e292bd5 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:02 devstack sudo[97242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-bba2e311-c4a3-4517-9426-ae764e292bd5 Jun 04 06:35:02 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:02 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7f08bfc0-7891-4b89-81bc-218d7d4f049a tempest-VolumesImageMetadata-654496294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a2aace28-7230-43af-8f75-e46b81558993" returned: 0 in 0.763s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7f08bfc0-7891-4b89-81bc-218d7d4f049a tempest-VolumesImageMetadata-654496294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a2aace28-7230-43af-8f75-e46b81558993 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:02 devstack sudo[97244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a2aace28-7230-43af-8f75-e46b81558993 Jun 04 06:35:02 devstack sudo[97244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:02 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ca812684-98b9-4c32-9d96-8dd61ecc6efa tempest-VolumesListTestJSON-1822522978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-bba2e311-c4a3-4517-9426-ae764e292bd5" returned: 0 in 0.988s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:03 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ca812684-98b9-4c32-9d96-8dd61ecc6efa tempest-VolumesListTestJSON-1822522978 None] Lock "cinder-quobyte-bba2e311-c4a3-4517-9426-ae764e292bd5" released by "delete_volume" :: held 1.871s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:35:03 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6e49cabf-e56a-45ed-8e4a-906cf2313fd4_vmhucfzpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ea9f5036-7618-4d24-96b7-eea1e700938b" returned: 0 in 1.153s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:03 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6e49cabf-e56a-45ed-8e4a-906cf2313fd4_vmhucfzpdevstack@QuobyteHD, size 0.00 MB, duration 1.15 sec, destination /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ea9f5036-7618-4d24-96b7-eea1e700938b {{(pid=86069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 06:35:03 devstack cinder-volume[86069]: INFO cinder.image.image_utils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Converted 0.00 MB image at 0.00 MB/s Jun 04 06:35:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ea9f5036-7618-4d24-96b7-eea1e700938b 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:03 devstack sudo[97304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ea9f5036-7618-4d24-96b7-eea1e700938b 1G Jun 04 06:35:03 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:03 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-ca812684-98b9-4c32-9d96-8dd61ecc6efa tempest-VolumesListTestJSON-1822522978 None] Created reservations ['fcbf5ed0-7dcf-4f53-8753-b3e83c600123', '1711f243-cbad-47d8-8d66-cbe696bf84d0', '6b4766e3-eeaa-4962-9da9-859bdd8bd4cc', '5bd02600-8ac7-4640-8232-2424d1b8ecbd'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:35:03 devstack sudo[97244]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7f08bfc0-7891-4b89-81bc-218d7d4f049a tempest-VolumesImageMetadata-654496294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a2aace28-7230-43af-8f75-e46b81558993" returned: 1 in 1.193s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7f08bfc0-7891-4b89-81bc-218d7d4f049a tempest-VolumesImageMetadata-654496294 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a2aace28-7230-43af-8f75-e46b81558993' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:35:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7f08bfc0-7891-4b89-81bc-218d7d4f049a tempest-VolumesImageMetadata-654496294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a2aace28-7230-43af-8f75-e46b81558993 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:03 devstack sudo[97311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a2aace28-7230-43af-8f75-e46b81558993 Jun 04 06:35:03 devstack sudo[97311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ca812684-98b9-4c32-9d96-8dd61ecc6efa tempest-VolumesListTestJSON-1822522978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:35:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ca812684-98b9-4c32-9d96-8dd61ecc6efa tempest-VolumesListTestJSON-1822522978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:35:03 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ca812684-98b9-4c32-9d96-8dd61ecc6efa tempest-VolumesListTestJSON-1822522978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:35:03 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ca812684-98b9-4c32-9d96-8dd61ecc6efa tempest-VolumesListTestJSON-1822522978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:35:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ca812684-98b9-4c32-9d96-8dd61ecc6efa tempest-VolumesListTestJSON-1822522978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:35:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ca812684-98b9-4c32-9d96-8dd61ecc6efa tempest-VolumesListTestJSON-1822522978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:03 devstack sudo[97315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:35:03 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:04 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ea9f5036-7618-4d24-96b7-eea1e700938b 1G" returned: 0 in 1.212s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:04 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b47dc8-83d6-4daa-a46d-b8e447eb71fb]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:35:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ea9f5036-7618-4d24-96b7-eea1e700938b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:04 devstack sudo[97311]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7f08bfc0-7891-4b89-81bc-218d7d4f049a tempest-VolumesImageMetadata-654496294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a2aace28-7230-43af-8f75-e46b81558993" returned: 0 in 1.127s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:04 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7f08bfc0-7891-4b89-81bc-218d7d4f049a tempest-VolumesImageMetadata-654496294 None] Lock "cinder-quobyte-a2aace28-7230-43af-8f75-e46b81558993" released by "delete_volume" :: held 3.161s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:35:04 devstack sudo[97327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ea9f5036-7618-4d24-96b7-eea1e700938b Jun 04 06:35:04 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:04 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-7f08bfc0-7891-4b89-81bc-218d7d4f049a tempest-VolumesImageMetadata-654496294 None] Created reservations ['364c5e4b-64b6-4abb-94d9-273a82e0aca3', 'c7acc209-13b3-47ae-bf16-6cdc1ae9e833', '90a09a36-9879-444f-9b2b-6eb925cdedfd', '8dc1d090-dda0-4ca2-ad01-754262cc65c8'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:35:04 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ca812684-98b9-4c32-9d96-8dd61ecc6efa tempest-VolumesListTestJSON-1822522978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.166s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:04 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-ca812684-98b9-4c32-9d96-8dd61ecc6efa tempest-VolumesListTestJSON-1822522978 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:35:04 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-ca812684-98b9-4c32-9d96-8dd61ecc6efa tempest-VolumesListTestJSON-1822522978 None] Deleted volume successfully. Jun 04 06:35:04 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ca812684-98b9-4c32-9d96-8dd61ecc6efa tempest-VolumesListTestJSON-1822522978 None] Lock "cinder-bba2e311-c4a3-4517-9426-ae764e292bd5-delete_volume" released by "delete_volume" :: held 3.680s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:35:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7f08bfc0-7891-4b89-81bc-218d7d4f049a tempest-VolumesImageMetadata-654496294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:35:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7f08bfc0-7891-4b89-81bc-218d7d4f049a tempest-VolumesImageMetadata-654496294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:35:04 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7f08bfc0-7891-4b89-81bc-218d7d4f049a tempest-VolumesImageMetadata-654496294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:35:04 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7f08bfc0-7891-4b89-81bc-218d7d4f049a tempest-VolumesImageMetadata-654496294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:35:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7f08bfc0-7891-4b89-81bc-218d7d4f049a tempest-VolumesImageMetadata-654496294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:35:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7f08bfc0-7891-4b89-81bc-218d7d4f049a tempest-VolumesImageMetadata-654496294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:04 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-3e8a7bef-3e81-4f15-b445-b47c0a119c69 tempest-VolumesListTestJSON-1822522978 None] Acquiring lock "cinder-5912bbf7-4067-4bdf-b4c9-2d96c13a96c8-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:35:04 devstack sudo[97330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:35:04 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:04 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-3e8a7bef-3e81-4f15-b445-b47c0a119c69 tempest-VolumesListTestJSON-1822522978 None] Lock "cinder-5912bbf7-4067-4bdf-b4c9-2d96c13a96c8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:35:04 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-3e8a7bef-3e81-4f15-b445-b47c0a119c69 tempest-VolumesListTestJSON-1822522978 None] Acquiring lock "cinder-quobyte-5912bbf7-4067-4bdf-b4c9-2d96c13a96c8" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:35:04 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-3e8a7bef-3e81-4f15-b445-b47c0a119c69 tempest-VolumesListTestJSON-1822522978 None] Lock "cinder-quobyte-5912bbf7-4067-4bdf-b4c9-2d96c13a96c8" acquired by "delete_volume" :: waited 0.044s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:35:04 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ae17d9-242f-4937-8f24-3c226d72af75]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:35:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3e8a7bef-3e81-4f15-b445-b47c0a119c69 tempest-VolumesListTestJSON-1822522978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5912bbf7-4067-4bdf-b4c9-2d96c13a96c8 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:05 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5912bbf7-4067-4bdf-b4c9-2d96c13a96c8 Jun 04 06:35:05 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:05 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ea9f5036-7618-4d24-96b7-eea1e700938b" returned: 0 in 1.427s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ea9f5036-7618-4d24-96b7-eea1e700938b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:05 devstack sudo[97337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ea9f5036-7618-4d24-96b7-eea1e700938b Jun 04 06:35:05 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:05 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7f08bfc0-7891-4b89-81bc-218d7d4f049a tempest-VolumesImageMetadata-654496294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.273s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:06 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-7f08bfc0-7891-4b89-81bc-218d7d4f049a tempest-VolumesImageMetadata-654496294 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:35:06 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-7f08bfc0-7891-4b89-81bc-218d7d4f049a tempest-VolumesImageMetadata-654496294 None] Deleted volume successfully. Jun 04 06:35:06 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7f08bfc0-7891-4b89-81bc-218d7d4f049a tempest-VolumesImageMetadata-654496294 None] Lock "cinder-a2aace28-7230-43af-8f75-e46b81558993-delete_volume" released by "delete_volume" :: held 4.943s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:35:06 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3e8a7bef-3e81-4f15-b445-b47c0a119c69 tempest-VolumesListTestJSON-1822522978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5912bbf7-4067-4bdf-b4c9-2d96c13a96c8" returned: 0 in 1.539s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3e8a7bef-3e81-4f15-b445-b47c0a119c69 tempest-VolumesListTestJSON-1822522978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5912bbf7-4067-4bdf-b4c9-2d96c13a96c8 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:06 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5912bbf7-4067-4bdf-b4c9-2d96c13a96c8 Jun 04 06:35:06 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:06 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ea9f5036-7618-4d24-96b7-eea1e700938b" returned: 1 in 0.997s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ea9f5036-7618-4d24-96b7-eea1e700938b' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:35:06 devstack cinder-volume[86069]: DEBUG cinder.volume.volume_utils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Downloaded image 6e49cabf-e56a-45ed-8e4a-906cf2313fd4 ((None, [{'url': 'file:///opt/stack/data/glance/images/6e49cabf-e56a-45ed-8e4a-906cf2313fd4', 'metadata': {}}])) to volume ea9f5036-7618-4d24-96b7-eea1e700938b successfully. {{(pid=86069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 04 06:35:06 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Temporary image 6e49cabf-e56a-45ed-8e4a-906cf2313fd4 for user 670af691097640e39c091fc77ecae8a3 is deleted. {{(pid=86069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 04 06:35:06 devstack cinder-volume[86069]: DEBUG cinder.volume.volume_utils [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Marking volume ea9f5036-7618-4d24-96b7-eea1e700938b as bootable. {{(pid=86069) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 04 06:35:06 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Copying metadata from image 6e49cabf-e56a-45ed-8e4a-906cf2313fd4 to ea9f5036-7618-4d24-96b7-eea1e700938b. {{(pid=86069) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 04 06:35:06 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Creating volume glance metadata for volume ea9f5036-7618-4d24-96b7-eea1e700938b backed by image 6e49cabf-e56a-45ed-8e4a-906cf2313fd4 with: {'image_id': '6e49cabf-e56a-45ed-8e4a-906cf2313fd4', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '192d0fe3324e2ac771e8705fc73cb801', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86069) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 04 06:35:06 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b4ba9a3-c9c5-4392-b239-b25000d0e8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea9f5036-7618-4d24-96b7-eea1e700938b', 'volume_size': 1, 'image_id': '6e49cabf-e56a-45ed-8e4a-906cf2313fd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e49cabf-e56a-45ed-8e4a-906cf2313fd4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '192d0fe3324e2ac771e8705fc73cb801', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dc943de804aa401d90abcc9aa6623fd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0586d1948e37b79d9b38e2e97ebfbd15234e76475a6a65abda72db6fe579b93ced8678271418c50328e6fb89f5fe7252aaf1040aa6fa26ef04e9583578eef57b', 'id': '6e49cabf-e56a-45ed-8e4a-906cf2313fd4', 'created_at': datetime.datetime(2026, 6, 4, 4, 34, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 4, 34, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e49cabf-e56a-45ed-8e4a-906cf2313fd4/file', 'properties': {}}, 'image_service': }' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:06 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91b28da1-d465-4916-92dd-a9092b2392d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:07 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Volume volume-ea9f5036-7618-4d24-96b7-eea1e700938b (ea9f5036-7618-4d24-96b7-eea1e700938b): created successfully Jun 04 06:35:07 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91b28da1-d465-4916-92dd-a9092b2392d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:07 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Flow 'volume_create_manager' (82feae55-84fe-42ba-afd9-d28de33c63d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:35:07 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-a0f0c981-fb77-467a-a748-c54183ceef8f tempest-VolumeImageDependencyTests-1600484130 None] Created volume successfully. Jun 04 06:35:07 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3e8a7bef-3e81-4f15-b445-b47c0a119c69 tempest-VolumesListTestJSON-1822522978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5912bbf7-4067-4bdf-b4c9-2d96c13a96c8" returned: 0 in 1.006s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:07 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-3e8a7bef-3e81-4f15-b445-b47c0a119c69 tempest-VolumesListTestJSON-1822522978 None] Lock "cinder-quobyte-5912bbf7-4067-4bdf-b4c9-2d96c13a96c8" released by "delete_volume" :: held 2.645s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:35:07 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-3e8a7bef-3e81-4f15-b445-b47c0a119c69 tempest-VolumesListTestJSON-1822522978 None] Created reservations ['b613e1c5-7400-4161-be81-20d426e4c773', 'aa9274d6-04c9-490f-abef-e4c7d7432168', '3329d1d2-8160-452d-bdf7-59a9bc4107dd', '29b1962a-ff6b-4aef-ae7b-54e384939ae2'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:35:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-3e8a7bef-3e81-4f15-b445-b47c0a119c69 tempest-VolumesListTestJSON-1822522978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:35:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-3e8a7bef-3e81-4f15-b445-b47c0a119c69 tempest-VolumesListTestJSON-1822522978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:35:07 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-3e8a7bef-3e81-4f15-b445-b47c0a119c69 tempest-VolumesListTestJSON-1822522978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:35:07 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-3e8a7bef-3e81-4f15-b445-b47c0a119c69 tempest-VolumesListTestJSON-1822522978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:35:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-3e8a7bef-3e81-4f15-b445-b47c0a119c69 tempest-VolumesListTestJSON-1822522978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:35:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3e8a7bef-3e81-4f15-b445-b47c0a119c69 tempest-VolumesListTestJSON-1822522978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:07 devstack sudo[97351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:35:07 devstack sudo[97351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:08 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-3946f5c2-7573-4cad-a9f5-004c837f1ae3 tempest-VolumeImageDependencyTests-1600484130 None] Acquiring lock "cinder-ea9f5036-7618-4d24-96b7-eea1e700938b-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:35:08 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-3946f5c2-7573-4cad-a9f5-004c837f1ae3 tempest-VolumeImageDependencyTests-1600484130 None] Lock "cinder-ea9f5036-7618-4d24-96b7-eea1e700938b-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:35:08 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-3946f5c2-7573-4cad-a9f5-004c837f1ae3 tempest-VolumeImageDependencyTests-1600484130 None] Acquiring lock "cinder-quobyte-ea9f5036-7618-4d24-96b7-eea1e700938b" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:35:08 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-3946f5c2-7573-4cad-a9f5-004c837f1ae3 tempest-VolumeImageDependencyTests-1600484130 None] Lock "cinder-quobyte-ea9f5036-7618-4d24-96b7-eea1e700938b" acquired by "delete_volume" :: waited 0.049s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:35:08 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[06906092-cb59-40e5-a3bd-87dfe3459752]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:35:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3946f5c2-7573-4cad-a9f5-004c837f1ae3 tempest-VolumeImageDependencyTests-1600484130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ea9f5036-7618-4d24-96b7-eea1e700938b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:08 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-50f66a93-54c2-4f49-b491-0513c6202244 tempest-VolumesListTestJSON-1822522978 None] Acquiring lock "cinder-d7bd72ec-dba8-4e1a-97e3-2857cb73aebc-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:35:08 devstack sudo[97351]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3e8a7bef-3e81-4f15-b445-b47c0a119c69 tempest-VolumesListTestJSON-1822522978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.068s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:08 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-3e8a7bef-3e81-4f15-b445-b47c0a119c69 tempest-VolumesListTestJSON-1822522978 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:35:08 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-3e8a7bef-3e81-4f15-b445-b47c0a119c69 tempest-VolumesListTestJSON-1822522978 None] Deleted volume successfully. Jun 04 06:35:08 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-50f66a93-54c2-4f49-b491-0513c6202244 tempest-VolumesListTestJSON-1822522978 None] Lock "cinder-d7bd72ec-dba8-4e1a-97e3-2857cb73aebc-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:35:08 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-3e8a7bef-3e81-4f15-b445-b47c0a119c69 tempest-VolumesListTestJSON-1822522978 None] Lock "cinder-5912bbf7-4067-4bdf-b4c9-2d96c13a96c8-delete_volume" released by "delete_volume" :: held 4.095s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:35:08 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-50f66a93-54c2-4f49-b491-0513c6202244 tempest-VolumesListTestJSON-1822522978 None] Acquiring lock "cinder-quobyte-d7bd72ec-dba8-4e1a-97e3-2857cb73aebc" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:35:09 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-50f66a93-54c2-4f49-b491-0513c6202244 tempest-VolumesListTestJSON-1822522978 None] Lock "cinder-quobyte-d7bd72ec-dba8-4e1a-97e3-2857cb73aebc" acquired by "delete_volume" :: waited 0.052s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:35:09 devstack sudo[97354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ea9f5036-7618-4d24-96b7-eea1e700938b Jun 04 06:35:09 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:09 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[417e194c-a8e4-497f-a6b9-b360bb4f2ad2]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:35:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-50f66a93-54c2-4f49-b491-0513c6202244 tempest-VolumesListTestJSON-1822522978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d7bd72ec-dba8-4e1a-97e3-2857cb73aebc {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:09 devstack sudo[97361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d7bd72ec-dba8-4e1a-97e3-2857cb73aebc Jun 04 06:35:09 devstack sudo[97361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:09 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3946f5c2-7573-4cad-a9f5-004c837f1ae3 tempest-VolumeImageDependencyTests-1600484130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ea9f5036-7618-4d24-96b7-eea1e700938b" returned: 0 in 1.258s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3946f5c2-7573-4cad-a9f5-004c837f1ae3 tempest-VolumeImageDependencyTests-1600484130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ea9f5036-7618-4d24-96b7-eea1e700938b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:10 devstack sudo[97369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ea9f5036-7618-4d24-96b7-eea1e700938b Jun 04 06:35:10 devstack sudo[97369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:10 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:35:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] Flow 'volume_create_manager' (2ad5a905-85e7-40a3-8f75-c85942f1531f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:35:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0f2c247-91da-4f34-b229-18ee2a346500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0f2c247-91da-4f34-b229-18ee2a346500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-625988130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c513ef8d-db6c-4f2f-93b8-ca94552c485c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee5ae49cd6794073a63af50335e87f30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:35:10Z,use_quota=True,user_id='e61c9f3c8a6f4ffaa283f872f1c00103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e236db43-b3c7-429e-99ec-b05cd939e506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e236db43-b3c7-429e-99ec-b05cd939e506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (354f8475-dac7-4d09-b99f-2b26f492e494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (354f8475-dac7-4d09-b99f-2b26f492e494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c513ef8d-db6c-4f2f-93b8-ca94552c485c', 'volume_name': 'volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91995d5c-0f12-4c90-9ce4-d9ee739b4200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91995d5c-0f12-4c90-9ce4-d9ee739b4200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f10993-0ef2-4713-8b64-b0949a1d2782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:10 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] Volume c513ef8d-db6c-4f2f-93b8-ca94552c485c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c', 'volume_size': 1} Jun 04 06:35:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:35:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:35:10 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-625988130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c513ef8d-db6c-4f2f-93b8-ca94552c485c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee5ae49cd6794073a63af50335e87f30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:35:10Z,use_quota=True,user_id='e61c9f3c8a6f4ffaa283f872f1c00103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:35:10 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] Creating volume c513ef8d-db6c-4f2f-93b8-ca94552c485c {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:35:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:35:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:35:10 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:35:10 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:35:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:35:10 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:35:10 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:35:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:10 devstack sudo[97374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c 1073741824 Jun 04 06:35:10 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:10 devstack sudo[97361]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-50f66a93-54c2-4f49-b491-0513c6202244 tempest-VolumesListTestJSON-1822522978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d7bd72ec-dba8-4e1a-97e3-2857cb73aebc" returned: 0 in 1.741s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-50f66a93-54c2-4f49-b491-0513c6202244 tempest-VolumesListTestJSON-1822522978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d7bd72ec-dba8-4e1a-97e3-2857cb73aebc {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:10 devstack sudo[97376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d7bd72ec-dba8-4e1a-97e3-2857cb73aebc Jun 04 06:35:10 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:35:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:35:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:35:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:35:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:35:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:35:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:11 devstack sudo[97382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:35:11 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:11 devstack sudo[97369]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3946f5c2-7573-4cad-a9f5-004c837f1ae3 tempest-VolumeImageDependencyTests-1600484130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ea9f5036-7618-4d24-96b7-eea1e700938b" returned: 1 in 1.321s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3946f5c2-7573-4cad-a9f5-004c837f1ae3 tempest-VolumeImageDependencyTests-1600484130 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ea9f5036-7618-4d24-96b7-eea1e700938b' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:35:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3946f5c2-7573-4cad-a9f5-004c837f1ae3 tempest-VolumeImageDependencyTests-1600484130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ea9f5036-7618-4d24-96b7-eea1e700938b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:11 devstack sudo[97384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ea9f5036-7618-4d24-96b7-eea1e700938b Jun 04 06:35:11 devstack sudo[97384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:11 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-50f66a93-54c2-4f49-b491-0513c6202244 tempest-VolumesListTestJSON-1822522978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d7bd72ec-dba8-4e1a-97e3-2857cb73aebc" returned: 0 in 1.124s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:11 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-50f66a93-54c2-4f49-b491-0513c6202244 tempest-VolumesListTestJSON-1822522978 None] Lock "cinder-quobyte-d7bd72ec-dba8-4e1a-97e3-2857cb73aebc" released by "delete_volume" :: held 2.955s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:35:12 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-50f66a93-54c2-4f49-b491-0513c6202244 tempest-VolumesListTestJSON-1822522978 None] Created reservations ['78a91792-1b74-41d5-9b5f-29e6c378eb23', 'a8991ea0-283b-416f-b89c-2bb7e2226d24', '7e529b01-e2b7-48e8-8e67-e8dbadc83089', 'e518b22b-cf53-4090-b82c-6739ee688a4a'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:35:12 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c 1073741824" returned: 0 in 1.610s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-50f66a93-54c2-4f49-b491-0513c6202244 tempest-VolumesListTestJSON-1822522978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:35:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-50f66a93-54c2-4f49-b491-0513c6202244 tempest-VolumesListTestJSON-1822522978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:35:12 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-50f66a93-54c2-4f49-b491-0513c6202244 tempest-VolumesListTestJSON-1822522978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:35:12 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-50f66a93-54c2-4f49-b491-0513c6202244 tempest-VolumesListTestJSON-1822522978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:35:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-50f66a93-54c2-4f49-b491-0513c6202244 tempest-VolumesListTestJSON-1822522978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:35:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-50f66a93-54c2-4f49-b491-0513c6202244 tempest-VolumesListTestJSON-1822522978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:12 devstack sudo[97384]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:12 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:12 devstack sudo[97393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:35:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.182s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:12 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3946f5c2-7573-4cad-a9f5-004c837f1ae3 tempest-VolumeImageDependencyTests-1600484130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-ea9f5036-7618-4d24-96b7-eea1e700938b" returned: 0 in 1.091s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:12 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:35:12 devstack sudo[97394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c Jun 04 06:35:12 devstack sudo[97394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:12 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager._thread_info {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:35:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread count: 28 {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 06:35:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread info: [<_MainThread(MainThread, started 131797370544256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 06:35:12 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-3946f5c2-7573-4cad-a9f5-004c837f1ae3 tempest-VolumeImageDependencyTests-1600484130 None] Lock "cinder-quobyte-ea9f5036-7618-4d24-96b7-eea1e700938b" released by "delete_volume" :: held 3.865s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:35:12 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-3946f5c2-7573-4cad-a9f5-004c837f1ae3 tempest-VolumeImageDependencyTests-1600484130 None] Created reservations ['bc758bec-38a6-40ba-a858-88e99665ff0b', '721b576d-4670-476e-9bd9-300530dba155', '47aa7110-e6c0-4bd0-8cbc-cd5055ac147c', '11434b4b-c405-4235-a847-58b2db3d5f4b'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:35:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-3946f5c2-7573-4cad-a9f5-004c837f1ae3 tempest-VolumeImageDependencyTests-1600484130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:35:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-3946f5c2-7573-4cad-a9f5-004c837f1ae3 tempest-VolumeImageDependencyTests-1600484130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:35:12 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-3946f5c2-7573-4cad-a9f5-004c837f1ae3 tempest-VolumeImageDependencyTests-1600484130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:35:12 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-3946f5c2-7573-4cad-a9f5-004c837f1ae3 tempest-VolumeImageDependencyTests-1600484130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:35:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-3946f5c2-7573-4cad-a9f5-004c837f1ae3 tempest-VolumeImageDependencyTests-1600484130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:35:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3946f5c2-7573-4cad-a9f5-004c837f1ae3 tempest-VolumeImageDependencyTests-1600484130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:12 devstack sudo[97397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:35:12 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:13 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-50f66a93-54c2-4f49-b491-0513c6202244 tempest-VolumesListTestJSON-1822522978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.073s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:13 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-50f66a93-54c2-4f49-b491-0513c6202244 tempest-VolumesListTestJSON-1822522978 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:35:13 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-50f66a93-54c2-4f49-b491-0513c6202244 tempest-VolumesListTestJSON-1822522978 None] Deleted volume successfully. Jun 04 06:35:13 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-50f66a93-54c2-4f49-b491-0513c6202244 tempest-VolumesListTestJSON-1822522978 None] Lock "cinder-d7bd72ec-dba8-4e1a-97e3-2857cb73aebc-delete_volume" released by "delete_volume" :: held 4.599s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:35:13 devstack sudo[97394]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c" returned: 0 in 1.220s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:13 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] <== create_volume: return (2971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:35:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.980s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:35:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f10993-0ef2-4713-8b64-b0949a1d2782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e13a4ef-4296-4bd0-931d-ada85f1332a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:13 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] Volume volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c (c513ef8d-db6c-4f2f-93b8-ca94552c485c): created successfully Jun 04 06:35:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e13a4ef-4296-4bd0-931d-ada85f1332a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] Flow 'volume_create_manager' (2ad5a905-85e7-40a3-8f75-c85942f1531f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:35:13 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-d083b1d9-1562-49b1-b2ea-2afb16a52d2e tempest-VolumesDeleteCascade-49272846 None] Created volume successfully. Jun 04 06:35:13 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3946f5c2-7573-4cad-a9f5-004c837f1ae3 tempest-VolumeImageDependencyTests-1600484130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.292s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:13 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-3946f5c2-7573-4cad-a9f5-004c837f1ae3 tempest-VolumeImageDependencyTests-1600484130 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:35:13 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-3946f5c2-7573-4cad-a9f5-004c837f1ae3 tempest-VolumeImageDependencyTests-1600484130 None] Deleted volume successfully. Jun 04 06:35:14 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-3946f5c2-7573-4cad-a9f5-004c837f1ae3 tempest-VolumeImageDependencyTests-1600484130 None] Lock "cinder-ea9f5036-7618-4d24-96b7-eea1e700938b-delete_volume" released by "delete_volume" :: held 5.653s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:35:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-1fc7023b-98ad-4ec8-98ba-2362dc0ebc32 tempest-VolumesDeleteCascade-49272846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:35:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-1fc7023b-98ad-4ec8-98ba-2362dc0ebc32 tempest-VolumesDeleteCascade-49272846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:35:14 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-1fc7023b-98ad-4ec8-98ba-2362dc0ebc32 tempest-VolumesDeleteCascade-49272846 None] Creating offline snapshot 95b4e880-215f-4b30-a01e-3cd5b033a6e0 of volume c513ef8d-db6c-4f2f-93b8-ca94552c485c {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:35:14 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f9cf51-3941-43b6-b6f9-0f87ba0b3c89]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:35:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1fc7023b-98ad-4ec8-98ba-2362dc0ebc32 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:14 devstack sudo[97402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c Jun 04 06:35:14 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:15 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1fc7023b-98ad-4ec8-98ba-2362dc0ebc32 tempest-VolumesDeleteCascade-49272846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c" returned: 0 in 0.968s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1fc7023b-98ad-4ec8-98ba-2362dc0ebc32 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.95b4e880-215f-4b30-a01e-3cd5b033a6e0 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:15 devstack sudo[97407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.95b4e880-215f-4b30-a01e-3cd5b033a6e0 1G Jun 04 06:35:15 devstack sudo[97407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:16 devstack sudo[97407]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1fc7023b-98ad-4ec8-98ba-2362dc0ebc32 tempest-VolumesDeleteCascade-49272846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.95b4e880-215f-4b30-a01e-3cd5b033a6e0 1G" returned: 0 in 0.910s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1fc7023b-98ad-4ec8-98ba-2362dc0ebc32 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.95b4e880-215f-4b30-a01e-3cd5b033a6e0 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:16 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.95b4e880-215f-4b30-a01e-3cd5b033a6e0 Jun 04 06:35:16 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:17 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1fc7023b-98ad-4ec8-98ba-2362dc0ebc32 tempest-VolumesDeleteCascade-49272846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.95b4e880-215f-4b30-a01e-3cd5b033a6e0" returned: 0 in 0.941s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:17 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-1fc7023b-98ad-4ec8-98ba-2362dc0ebc32 tempest-VolumesDeleteCascade-49272846 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.95b4e880-215f-4b30-a01e-3cd5b033a6e0 is being set with open permissions: ugo+rw Jun 04 06:35:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1fc7023b-98ad-4ec8-98ba-2362dc0ebc32 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.95b4e880-215f-4b30-a01e-3cd5b033a6e0 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:17 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.95b4e880-215f-4b30-a01e-3cd5b033a6e0 Jun 04 06:35:17 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:17 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1fc7023b-98ad-4ec8-98ba-2362dc0ebc32 tempest-VolumesDeleteCascade-49272846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.95b4e880-215f-4b30-a01e-3cd5b033a6e0" returned: 0 in 0.793s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1fc7023b-98ad-4ec8-98ba-2362dc0ebc32 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:17 devstack sudo[97441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.info Jun 04 06:35:17 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:18 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1fc7023b-98ad-4ec8-98ba-2362dc0ebc32 tempest-VolumesDeleteCascade-49272846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.info" returned: 0 in 0.827s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:18 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-1fc7023b-98ad-4ec8-98ba-2362dc0ebc32 tempest-VolumesDeleteCascade-49272846 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.info is being set with open permissions: ugo+rw Jun 04 06:35:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1fc7023b-98ad-4ec8-98ba-2362dc0ebc32 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:18 devstack sudo[97444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.info Jun 04 06:35:18 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:19 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1fc7023b-98ad-4ec8-98ba-2362dc0ebc32 tempest-VolumesDeleteCascade-49272846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.info" returned: 0 in 0.693s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-1fc7023b-98ad-4ec8-98ba-2362dc0ebc32 tempest-VolumesDeleteCascade-49272846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.262s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:35:19 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-1fc7023b-98ad-4ec8-98ba-2362dc0ebc32 tempest-VolumesDeleteCascade-49272846 None] Create snapshot completed successfully Jun 04 06:35:20 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=108,cinder:INSERT=37,cinder:UPDATE=108,cinder:DELETE=17 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:35:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-6c4172e3-b436-497c-bb06-9b92e928dad2 tempest-VolumesDeleteCascade-49272846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:35:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-6c4172e3-b436-497c-bb06-9b92e928dad2 tempest-VolumesDeleteCascade-49272846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:35:20 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-6c4172e3-b436-497c-bb06-9b92e928dad2 tempest-VolumesDeleteCascade-49272846 None] Creating offline snapshot e0cacb5f-b99d-4082-ba68-587b69af1995 of volume c513ef8d-db6c-4f2f-93b8-ca94552c485c {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:35:20 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb9f31d-c7b6-48e8-91e8-8144f3db9e4f]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:35:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6c4172e3-b436-497c-bb06-9b92e928dad2 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.95b4e880-215f-4b30-a01e-3cd5b033a6e0 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:20 devstack sudo[97447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.95b4e880-215f-4b30-a01e-3cd5b033a6e0 Jun 04 06:35:20 devstack sudo[97447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:21 devstack sudo[97447]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6c4172e3-b436-497c-bb06-9b92e928dad2 tempest-VolumesDeleteCascade-49272846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.95b4e880-215f-4b30-a01e-3cd5b033a6e0" returned: 0 in 0.765s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:21 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-6c4172e3-b436-497c-bb06-9b92e928dad2 tempest-VolumesDeleteCascade-49272846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:35:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6c4172e3-b436-497c-bb06-9b92e928dad2 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.95b4e880-215f-4b30-a01e-3cd5b033a6e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.e0cacb5f-b99d-4082-ba68-587b69af1995 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:21 devstack sudo[97452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.95b4e880-215f-4b30-a01e-3cd5b033a6e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.e0cacb5f-b99d-4082-ba68-587b69af1995 1G Jun 04 06:35:21 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:22 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6c4172e3-b436-497c-bb06-9b92e928dad2 tempest-VolumesDeleteCascade-49272846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.95b4e880-215f-4b30-a01e-3cd5b033a6e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.e0cacb5f-b99d-4082-ba68-587b69af1995 1G" returned: 0 in 0.989s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6c4172e3-b436-497c-bb06-9b92e928dad2 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.95b4e880-215f-4b30-a01e-3cd5b033a6e0 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.e0cacb5f-b99d-4082-ba68-587b69af1995 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:22 devstack sudo[97458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.95b4e880-215f-4b30-a01e-3cd5b033a6e0 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.e0cacb5f-b99d-4082-ba68-587b69af1995 Jun 04 06:35:22 devstack sudo[97458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:23 devstack sudo[97458]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6c4172e3-b436-497c-bb06-9b92e928dad2 tempest-VolumesDeleteCascade-49272846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.95b4e880-215f-4b30-a01e-3cd5b033a6e0 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.e0cacb5f-b99d-4082-ba68-587b69af1995" returned: 0 in 0.823s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:23 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-6c4172e3-b436-497c-bb06-9b92e928dad2 tempest-VolumesDeleteCascade-49272846 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.e0cacb5f-b99d-4082-ba68-587b69af1995 is being set with open permissions: ugo+rw Jun 04 06:35:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6c4172e3-b436-497c-bb06-9b92e928dad2 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.e0cacb5f-b99d-4082-ba68-587b69af1995 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:23 devstack sudo[97464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.e0cacb5f-b99d-4082-ba68-587b69af1995 Jun 04 06:35:23 devstack sudo[97464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:24 devstack sudo[97464]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6c4172e3-b436-497c-bb06-9b92e928dad2 tempest-VolumesDeleteCascade-49272846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.e0cacb5f-b99d-4082-ba68-587b69af1995" returned: 0 in 0.760s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-6c4172e3-b436-497c-bb06-9b92e928dad2 tempest-VolumesDeleteCascade-49272846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.500s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:35:24 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-6c4172e3-b436-497c-bb06-9b92e928dad2 tempest-VolumesDeleteCascade-49272846 None] Create snapshot completed successfully Jun 04 06:35:25 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Acquiring lock "cinder-c513ef8d-db6c-4f2f-93b8-ca94552c485c-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:35:25 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Lock "cinder-c513ef8d-db6c-4f2f-93b8-ca94552c485c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:35:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Performing cascade delete. {{(pid=86069) delete_volume /opt/stack/cinder/cinder/volume/manager.py:996}} Jun 04 06:35:25 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Acquiring lock "cinder-95b4e880-215f-4b30-a01e-3cd5b033a6e0-delete_snapshot" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:35:25 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Lock "cinder-95b4e880-215f-4b30-a01e-3cd5b033a6e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:35:25 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Acquiring lock "cinder-quobyte-c513ef8d-db6c-4f2f-93b8-ca94552c485c" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:35:25 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Lock "cinder-quobyte-c513ef8d-db6c-4f2f-93b8-ca94552c485c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:35:25 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Acquiring lock "cinder-quobyte-95b4e880-215f-4b30-a01e-3cd5b033a6e0" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:35:25 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Lock "cinder-quobyte-95b4e880-215f-4b30-a01e-3cd5b033a6e0" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:35:25 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Deleting offline snapshot 95b4e880-215f-4b30-a01e-3cd5b033a6e0 of volume c513ef8d-db6c-4f2f-93b8-ca94552c485c {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:35:25 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] snapshot_file for this snap is: volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.95b4e880-215f-4b30-a01e-3cd5b033a6e0 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:35:25 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d4ae54-604f-4d45-8fc5-67bf18c74208]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:35:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.95b4e880-215f-4b30-a01e-3cd5b033a6e0 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:25 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.95b4e880-215f-4b30-a01e-3cd5b033a6e0 Jun 04 06:35:25 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:26 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.95b4e880-215f-4b30-a01e-3cd5b033a6e0" returned: 0 in 0.872s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:26 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:35:26 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f8f1b1-724d-4633-a2e7-2909bc098ae9]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:35:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:26 devstack sudo[97473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c Jun 04 06:35:26 devstack sudo[97473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:27 devstack sudo[97473]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c" returned: 0 in 0.916s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:27 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[2572fbc8-de76-4f69-834d-059f1ede455d]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:35:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.e0cacb5f-b99d-4082-ba68-587b69af1995 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:27 devstack sudo[97479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.e0cacb5f-b99d-4082-ba68-587b69af1995 Jun 04 06:35:27 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:28 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.e0cacb5f-b99d-4082-ba68-587b69af1995" returned: 0 in 1.140s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:28 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:35:28 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a23a2a5-884c-4445-96b0-aecf82f6d0b2]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:35:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.95b4e880-215f-4b30-a01e-3cd5b033a6e0 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:28 devstack sudo[97523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.95b4e880-215f-4b30-a01e-3cd5b033a6e0 Jun 04 06:35:28 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:29 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.95b4e880-215f-4b30-a01e-3cd5b033a6e0" returned: 0 in 0.987s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:29 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:35:29 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[50dc4764-5d6b-41b7-99d2-6bf644ef29e1]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:35:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:29 devstack sudo[97531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c Jun 04 06:35:29 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:30 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:35:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] Flow 'volume_create_manager' (817fcab6-c461-4a66-a272-1ea305dc2712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:35:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80033486-e3a3-4bc5-9b45-2e46e0fa3ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80033486-e3a3-4bc5-9b45-2e46e0fa3ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-352111259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04e84166-152f-49ef-b6fd-fcc3d8f00326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f25af5158a894c938d0626b709972d27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:35:30Z,use_quota=True,user_id='515dd6f58ec3452d8daea2d739ebce01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a056d368-c930-436b-a06d-9cba6120a3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a056d368-c930-436b-a06d-9cba6120a3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c5b6ee-7e6a-4058-8cb0-bacfdd344215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c5b6ee-7e6a-4058-8cb0-bacfdd344215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04e84166-152f-49ef-b6fd-fcc3d8f00326', 'volume_name': 'volume-04e84166-152f-49ef-b6fd-fcc3d8f00326', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5854a76-c7af-4cad-b06c-15af76445909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5854a76-c7af-4cad-b06c-15af76445909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cee39620-6a1a-4836-ab7d-18f5163d3a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:30 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] Volume 04e84166-152f-49ef-b6fd-fcc3d8f00326: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04e84166-152f-49ef-b6fd-fcc3d8f00326', 'volume_size': 1} Jun 04 06:35:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:35:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:35:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-352111259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04e84166-152f-49ef-b6fd-fcc3d8f00326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f25af5158a894c938d0626b709972d27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:35:30Z,use_quota=True,user_id='515dd6f58ec3452d8daea2d739ebce01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:35:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] Creating volume 04e84166-152f-49ef-b6fd-fcc3d8f00326 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:35:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:35:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:35:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:35:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:35:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:35:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:35:30 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:35:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-04e84166-152f-49ef-b6fd-fcc3d8f00326 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:30 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-04e84166-152f-49ef-b6fd-fcc3d8f00326 1073741824 Jun 04 06:35:30 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:30 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c" returned: 0 in 1.081s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.95b4e880-215f-4b30-a01e-3cd5b033a6e0 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:30 devstack sudo[97540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.95b4e880-215f-4b30-a01e-3cd5b033a6e0 Jun 04 06:35:30 devstack sudo[97540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:31 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-04e84166-152f-49ef-b6fd-fcc3d8f00326 1073741824" returned: 0 in 1.022s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-04e84166-152f-49ef-b6fd-fcc3d8f00326 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:31 devstack sudo[97550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-04e84166-152f-49ef-b6fd-fcc3d8f00326 Jun 04 06:35:31 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:31 devstack sudo[97540]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.95b4e880-215f-4b30-a01e-3cd5b033a6e0" returned: 0 in 1.091s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.95b4e880-215f-4b30-a01e-3cd5b033a6e0 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:31 devstack sudo[97552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.95b4e880-215f-4b30-a01e-3cd5b033a6e0 Jun 04 06:35:31 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:32 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-04e84166-152f-49ef-b6fd-fcc3d8f00326" returned: 0 in 0.889s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:32 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] <== create_volume: return (1979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:35:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.983s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:35:32 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.95b4e880-215f-4b30-a01e-3cd5b033a6e0" returned: 0 in 0.792s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.e0cacb5f-b99d-4082-ba68-587b69af1995 -F qcow2 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:32 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cee39620-6a1a-4836-ab7d-18f5163d3a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04e84166-152f-49ef-b6fd-fcc3d8f00326', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:32 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.e0cacb5f-b99d-4082-ba68-587b69af1995 -F qcow2 Jun 04 06:35:32 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:32 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7163cebf-0eaf-41f8-8faa-91914e2ad4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:32 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] Volume volume-04e84166-152f-49ef-b6fd-fcc3d8f00326 (04e84166-152f-49ef-b6fd-fcc3d8f00326): created successfully Jun 04 06:35:32 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7163cebf-0eaf-41f8-8faa-91914e2ad4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:32 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] Flow 'volume_create_manager' (817fcab6-c461-4a66-a272-1ea305dc2712) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:35:32 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-8b144bcb-9d31-4f4d-af22-da66f1ce1266 tempest-AttachVolumeShelveTestJSON-2104168720 None] Created volume successfully. Jun 04 06:35:33 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.e0cacb5f-b99d-4082-ba68-587b69af1995 -F qcow2" returned: 0 in 0.846s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Lock "cinder-quobyte-95b4e880-215f-4b30-a01e-3cd5b033a6e0" released by "_delete_snapshot" :: held 8.031s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Lock "cinder-quobyte-c513ef8d-db6c-4f2f-93b8-ca94552c485c" released by "delete_snapshot" :: held 8.078s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Created reservations ['37a4863b-07ff-4909-917c-9d5ef7de2949', '8cf757ae-8748-407c-8971-f93436b38ebd', '29b059ed-5b1a-4d8b-b7ca-0da158ced828', 'b6167290-ad08-4ff2-9557-3cc1e5a118f4'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:35:33 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Delete snapshot completed successfully. Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Lock "cinder-95b4e880-215f-4b30-a01e-3cd5b033a6e0-delete_snapshot" released by "delete_snapshot" :: held 8.322s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Acquiring lock "cinder-e0cacb5f-b99d-4082-ba68-587b69af1995-delete_snapshot" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Lock "cinder-e0cacb5f-b99d-4082-ba68-587b69af1995-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Acquiring lock "cinder-quobyte-c513ef8d-db6c-4f2f-93b8-ca94552c485c" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] Flow 'volume_create_manager' (e86a3a1d-4018-4d41-9a9e-b01a0305c260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f62dcad3-b12f-42c5-9227-67b06b034acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Lock "cinder-quobyte-c513ef8d-db6c-4f2f-93b8-ca94552c485c" acquired by "delete_snapshot" :: waited 0.059s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Acquiring lock "cinder-quobyte-e0cacb5f-b99d-4082-ba68-587b69af1995" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f62dcad3-b12f-42c5-9227-67b06b034acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1084100351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56a08760-5686-43ee-aa09-446cd6b7a6f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3efeaf5c5c746c9b30246535ccbddd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:35:34Z,use_quota=True,user_id='c65b3028bde24d8da01c044e3ca0c87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb1d789-1ed4-4094-8812-a56cd99f4c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb1d789-1ed4-4094-8812-a56cd99f4c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a9c67d1-20bf-404d-b506-31b6abf8df93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a9c67d1-20bf-404d-b506-31b6abf8df93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56a08760-5686-43ee-aa09-446cd6b7a6f1', 'volume_name': 'volume-56a08760-5686-43ee-aa09-446cd6b7a6f1', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0287751-3e8b-4ee0-bab3-2a9ff79745f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0287751-3e8b-4ee0-bab3-2a9ff79745f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dca9c44-c3fe-45e6-96e8-e3c7e64dac58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:33 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] Volume 56a08760-5686-43ee-aa09-446cd6b7a6f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56a08760-5686-43ee-aa09-446cd6b7a6f1', 'volume_size': 1} Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1084100351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56a08760-5686-43ee-aa09-446cd6b7a6f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3efeaf5c5c746c9b30246535ccbddd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:35:34Z,use_quota=True,user_id='c65b3028bde24d8da01c044e3ca0c87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] Creating volume 56a08760-5686-43ee-aa09-446cd6b7a6f1 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:35:33 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Lock "cinder-quobyte-e0cacb5f-b99d-4082-ba68-587b69af1995" acquired by "_delete_snapshot" :: waited 0.109s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Deleting offline snapshot e0cacb5f-b99d-4082-ba68-587b69af1995 of volume c513ef8d-db6c-4f2f-93b8-ca94552c485c {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:35:33 devstack sudo[97566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1 1073741824 Jun 04 06:35:33 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] snapshot_file for this snap is: volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.e0cacb5f-b99d-4082-ba68-587b69af1995 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[680c63da-cfe8-4c5d-9007-3f45f1a6a672]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:35:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.e0cacb5f-b99d-4082-ba68-587b69af1995 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:34 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.e0cacb5f-b99d-4082-ba68-587b69af1995 Jun 04 06:35:34 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:34 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.e0cacb5f-b99d-4082-ba68-587b69af1995" returned: 0 in 1.066s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:35:34 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1 1073741824" returned: 0 in 1.183s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:34 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[439de6b4-b359-45fc-b55f-5e781b79cded]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:35:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:35 devstack sudo[97584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1 Jun 04 06:35:35 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:35 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c Jun 04 06:35:35 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:35 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c" returned: 0 in 0.912s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.e0cacb5f-b99d-4082-ba68-587b69af1995 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:35 devstack sudo[97592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.e0cacb5f-b99d-4082-ba68-587b69af1995 Jun 04 06:35:35 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:35 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1" returned: 0 in 0.969s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] <== create_volume: return (2238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:35:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.242s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:35:35 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dca9c44-c3fe-45e6-96e8-e3c7e64dac58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56a08760-5686-43ee-aa09-446cd6b7a6f1', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:35 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4637eaf0-ebdf-49d7-bd9f-d854b2d42df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:36 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] Volume volume-56a08760-5686-43ee-aa09-446cd6b7a6f1 (56a08760-5686-43ee-aa09-446cd6b7a6f1): created successfully Jun 04 06:35:36 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4637eaf0-ebdf-49d7-bd9f-d854b2d42df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:36 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] Flow 'volume_create_manager' (e86a3a1d-4018-4d41-9a9e-b01a0305c260) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:35:36 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-6df9e40e-6bcb-4063-a860-ae9c1ced7476 tempest-VolumesSnapshotTestJSON-1399893733 None] Created volume successfully. Jun 04 06:35:36 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.e0cacb5f-b99d-4082-ba68-587b69af1995" returned: 0 in 1.027s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.e0cacb5f-b99d-4082-ba68-587b69af1995 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:36 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.e0cacb5f-b99d-4082-ba68-587b69af1995 Jun 04 06:35:36 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a353aab3-48a2-4b23-acb2-345d0224445d tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:35:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a353aab3-48a2-4b23-acb2-345d0224445d tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:35:37 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-a353aab3-48a2-4b23-acb2-345d0224445d tempest-VolumesSnapshotTestJSON-1399893733 None] Creating offline snapshot 67c9f555-251e-4d39-803f-2511a661c5cb of volume 56a08760-5686-43ee-aa09-446cd6b7a6f1 {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:35:37 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d513f54-3601-4b79-9f77-913522201713]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:35:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a353aab3-48a2-4b23-acb2-345d0224445d tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:37 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1 Jun 04 06:35:37 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:37 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c.e0cacb5f-b99d-4082-ba68-587b69af1995" returned: 0 in 0.957s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:37 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Lock "cinder-quobyte-e0cacb5f-b99d-4082-ba68-587b69af1995" released by "_delete_snapshot" :: held 4.123s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:35:37 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Lock "cinder-quobyte-c513ef8d-db6c-4f2f-93b8-ca94552c485c" released by "delete_snapshot" :: held 4.247s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:35:37 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Created reservations ['29b52410-d303-45a1-95e2-df6947c7ecfa', '2ec9e09e-7313-4cef-be58-98bd1b600519', '30251c85-bb9a-48c6-8444-7ac97e6af86d', '300e3d20-e74c-4051-a582-d4a7e804bd9c'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:35:38 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Delete snapshot completed successfully. Jun 04 06:35:38 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Lock "cinder-e0cacb5f-b99d-4082-ba68-587b69af1995-delete_snapshot" released by "delete_snapshot" :: held 4.525s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:35:38 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Snapshots deleted, issuing volume delete {{(pid=86069) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1011}} Jun 04 06:35:38 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Acquiring lock "cinder-quobyte-c513ef8d-db6c-4f2f-93b8-ca94552c485c" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:35:38 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Lock "cinder-quobyte-c513ef8d-db6c-4f2f-93b8-ca94552c485c" acquired by "delete_volume" :: waited 0.024s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:35:38 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c78620-5fef-49a6-9f11-a1543ee7275d]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:35:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:38 devstack sudo[97644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c Jun 04 06:35:38 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:38 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a353aab3-48a2-4b23-acb2-345d0224445d tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1" returned: 0 in 1.118s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a353aab3-48a2-4b23-acb2-345d0224445d tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1.67c9f555-251e-4d39-803f-2511a661c5cb 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:38 devstack sudo[97649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1.67c9f555-251e-4d39-803f-2511a661c5cb 1G Jun 04 06:35:38 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:39 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c" returned: 0 in 0.895s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:39 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c Jun 04 06:35:39 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:39 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a353aab3-48a2-4b23-acb2-345d0224445d tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1.67c9f555-251e-4d39-803f-2511a661c5cb 1G" returned: 0 in 1.114s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a353aab3-48a2-4b23-acb2-345d0224445d tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56a08760-5686-43ee-aa09-446cd6b7a6f1 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1.67c9f555-251e-4d39-803f-2511a661c5cb {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:39 devstack sudo[97667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56a08760-5686-43ee-aa09-446cd6b7a6f1 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1.67c9f555-251e-4d39-803f-2511a661c5cb Jun 04 06:35:39 devstack sudo[97667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:40 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c513ef8d-db6c-4f2f-93b8-ca94552c485c" returned: 0 in 1.081s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:40 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Lock "cinder-quobyte-c513ef8d-db6c-4f2f-93b8-ca94552c485c" released by "delete_volume" :: held 2.075s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:35:40 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:INSERT=37,cinder:SELECT=75,cinder:UPDATE=95,cinder:DELETE=4 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:35:40 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Created reservations ['3ef7ac0c-8a99-45a0-9a39-f7090901d2a5', 'af8936c3-ccf6-4737-90f8-50fc4a70ad14', '8fa38039-5305-407c-b060-c7e39107f3c4', '6d1926f6-afc1-4bff-bbf6-5e80671654e3'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:35:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:35:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:35:40 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:35:40 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:35:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:35:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:40 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:35:40 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:40 devstack sudo[97667]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a353aab3-48a2-4b23-acb2-345d0224445d tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56a08760-5686-43ee-aa09-446cd6b7a6f1 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1.67c9f555-251e-4d39-803f-2511a661c5cb" returned: 0 in 1.075s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:40 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-a353aab3-48a2-4b23-acb2-345d0224445d tempest-VolumesSnapshotTestJSON-1399893733 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1.67c9f555-251e-4d39-803f-2511a661c5cb is being set with open permissions: ugo+rw Jun 04 06:35:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a353aab3-48a2-4b23-acb2-345d0224445d tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1.67c9f555-251e-4d39-803f-2511a661c5cb {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:40 devstack sudo[97676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1.67c9f555-251e-4d39-803f-2511a661c5cb Jun 04 06:35:40 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:41 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a353aab3-48a2-4b23-acb2-345d0224445d tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1.67c9f555-251e-4d39-803f-2511a661c5cb" returned: 0 in 1.074s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:41 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.353s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:41 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:35:41 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Deleted volume successfully. Jun 04 06:35:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a353aab3-48a2-4b23-acb2-345d0224445d tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:41 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-398b79f3-e3de-482d-bc31-e180ed3b5dd8 tempest-VolumesDeleteCascade-49272846 None] Lock "cinder-c513ef8d-db6c-4f2f-93b8-ca94552c485c-delete_volume" released by "delete_volume" :: held 16.785s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:35:41 devstack sudo[97682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1.info Jun 04 06:35:41 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:41 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:35:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] Flow 'volume_create_manager' (4a670549-f2b7-4d6a-a8f4-3e519f1da079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:35:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c721c7b4-98e1-4d03-938b-252adf1da64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c721c7b4-98e1-4d03-938b-252adf1da64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1431863848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a91eb1f9-9993-40fc-88de-7f39f7e35e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee5ae49cd6794073a63af50335e87f30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:35:42Z,use_quota=True,user_id='e61c9f3c8a6f4ffaa283f872f1c00103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6133a72-4525-4c36-ab11-f11106822b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6133a72-4525-4c36-ab11-f11106822b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36854dba-ff11-4f44-8c27-d6571f16aa5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36854dba-ff11-4f44-8c27-d6571f16aa5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a91eb1f9-9993-40fc-88de-7f39f7e35e54', 'volume_name': 'volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25e3dbc3-fb8c-49fc-b53f-0a452087df60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25e3dbc3-fb8c-49fc-b53f-0a452087df60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5032fc6d-cabc-4a42-93bb-66b916cd81d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:42 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] Volume a91eb1f9-9993-40fc-88de-7f39f7e35e54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54', 'volume_size': 1} Jun 04 06:35:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:35:42 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a353aab3-48a2-4b23-acb2-345d0224445d tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1.info" returned: 0 in 0.670s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:42 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-a353aab3-48a2-4b23-acb2-345d0224445d tempest-VolumesSnapshotTestJSON-1399893733 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1.info is being set with open permissions: ugo+rw Jun 04 06:35:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a353aab3-48a2-4b23-acb2-345d0224445d tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:42 devstack sudo[97685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1.info Jun 04 06:35:42 devstack sudo[97685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:43 devstack sudo[97685]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a353aab3-48a2-4b23-acb2-345d0224445d tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1.info" returned: 0 in 0.898s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a353aab3-48a2-4b23-acb2-345d0224445d tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.120s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:35:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.465s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:35:43 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1431863848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a91eb1f9-9993-40fc-88de-7f39f7e35e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee5ae49cd6794073a63af50335e87f30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:35:42Z,use_quota=True,user_id='e61c9f3c8a6f4ffaa283f872f1c00103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:35:43 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] Creating volume a91eb1f9-9993-40fc-88de-7f39f7e35e54 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:35:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:35:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:35:43 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:35:43 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:35:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:35:43 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:35:43 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:35:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:43 devstack sudo[97688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54 1073741824 Jun 04 06:35:43 devstack sudo[97688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:43 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-a353aab3-48a2-4b23-acb2-345d0224445d tempest-VolumesSnapshotTestJSON-1399893733 None] Create snapshot completed successfully Jun 04 06:35:44 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0314e33e-851f-491e-8320-06ffa26dbafa tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "cinder-67c9f555-251e-4d39-803f-2511a661c5cb-delete_snapshot" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:35:44 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0314e33e-851f-491e-8320-06ffa26dbafa tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-67c9f555-251e-4d39-803f-2511a661c5cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:35:44 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0314e33e-851f-491e-8320-06ffa26dbafa tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "cinder-quobyte-56a08760-5686-43ee-aa09-446cd6b7a6f1" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:35:44 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0314e33e-851f-491e-8320-06ffa26dbafa tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-quobyte-56a08760-5686-43ee-aa09-446cd6b7a6f1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:35:44 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0314e33e-851f-491e-8320-06ffa26dbafa tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "cinder-quobyte-67c9f555-251e-4d39-803f-2511a661c5cb" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:35:44 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0314e33e-851f-491e-8320-06ffa26dbafa tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-quobyte-67c9f555-251e-4d39-803f-2511a661c5cb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:35:44 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-0314e33e-851f-491e-8320-06ffa26dbafa tempest-VolumesSnapshotTestJSON-1399893733 None] Deleting offline snapshot 67c9f555-251e-4d39-803f-2511a661c5cb of volume 56a08760-5686-43ee-aa09-446cd6b7a6f1 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:35:44 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-0314e33e-851f-491e-8320-06ffa26dbafa tempest-VolumesSnapshotTestJSON-1399893733 None] snapshot_file for this snap is: volume-56a08760-5686-43ee-aa09-446cd6b7a6f1.67c9f555-251e-4d39-803f-2511a661c5cb {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:35:44 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd441f6-36a5-4284-9b5c-32a2d06db860]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:35:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0314e33e-851f-491e-8320-06ffa26dbafa tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1.67c9f555-251e-4d39-803f-2511a661c5cb {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:44 devstack sudo[97694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1.67c9f555-251e-4d39-803f-2511a661c5cb Jun 04 06:35:44 devstack sudo[97694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:44 devstack sudo[97688]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54 1073741824" returned: 0 in 1.107s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:44 devstack sudo[97696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54 Jun 04 06:35:44 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:45 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54" returned: 0 in 0.755s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:45 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] <== create_volume: return (1913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:35:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.919s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:35:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5032fc6d-cabc-4a42-93bb-66b916cd81d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e132570-e700-42c7-97c1-800c9540a583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:45 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] Volume volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54 (a91eb1f9-9993-40fc-88de-7f39f7e35e54): created successfully Jun 04 06:35:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e132570-e700-42c7-97c1-800c9540a583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] Flow 'volume_create_manager' (4a670549-f2b7-4d6a-a8f4-3e519f1da079) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:35:45 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-5fde7da9-a37b-4053-8606-a34694395fd9 tempest-VolumesDeleteCascade-49272846 None] Created volume successfully. Jun 04 06:35:45 devstack sudo[97694]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0314e33e-851f-491e-8320-06ffa26dbafa tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1.67c9f555-251e-4d39-803f-2511a661c5cb" returned: 0 in 1.074s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:45 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-0314e33e-851f-491e-8320-06ffa26dbafa tempest-VolumesSnapshotTestJSON-1399893733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56a08760-5686-43ee-aa09-446cd6b7a6f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:35:45 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[7282baa9-0d8b-470b-9823-e30cab94e9e7]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:35:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0314e33e-851f-491e-8320-06ffa26dbafa tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:45 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1 Jun 04 06:35:45 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:46 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0314e33e-851f-491e-8320-06ffa26dbafa tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1" returned: 0 in 0.801s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0314e33e-851f-491e-8320-06ffa26dbafa tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1.67c9f555-251e-4d39-803f-2511a661c5cb {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:46 devstack sudo[97708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1.67c9f555-251e-4d39-803f-2511a661c5cb Jun 04 06:35:46 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:46 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:35:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] Flow 'volume_create_manager' (8f7df6fd-5479-4eaf-b7c1-c79ae6160a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:35:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d410f09a-1416-43bd-afb1-ba7d4100c03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d410f09a-1416-43bd-afb1-ba7d4100c03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-321629269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4446a4b3-b851-491a-9171-27372e269015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e95a2cf99b047db951ab8857bfd84ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:35:46Z,use_quota=True,user_id='4d5e82bef464429ba6aa96512c022fd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8431acc4-f2b2-44de-8bdc-c7205e231a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8431acc4-f2b2-44de-8bdc-c7205e231a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69aaa197-75cb-40f2-bcec-e0c3e3a6347c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69aaa197-75cb-40f2-bcec-e0c3e3a6347c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4446a4b3-b851-491a-9171-27372e269015', 'volume_name': 'volume-4446a4b3-b851-491a-9171-27372e269015', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f537b71-c120-44a1-9c73-421d3097d483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f537b71-c120-44a1-9c73-421d3097d483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a12eea3-9608-493a-bd64-596b4508a1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:46 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] Volume 4446a4b3-b851-491a-9171-27372e269015: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4446a4b3-b851-491a-9171-27372e269015', 'volume_size': 1} Jun 04 06:35:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:35:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:35:46 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-321629269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4446a4b3-b851-491a-9171-27372e269015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e95a2cf99b047db951ab8857bfd84ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:35:46Z,use_quota=True,user_id='4d5e82bef464429ba6aa96512c022fd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:35:46 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] Creating volume 4446a4b3-b851-491a-9171-27372e269015 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:35:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:35:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:35:46 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:35:46 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:35:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:35:46 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:35:46 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:35:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:46 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015 1073741824 Jun 04 06:35:46 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-efd0e23b-99f2-4e49-8e2b-4cfad31cf9c9 tempest-VolumesDeleteCascade-49272846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:35:47 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0314e33e-851f-491e-8320-06ffa26dbafa tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1.67c9f555-251e-4d39-803f-2511a661c5cb" returned: 0 in 0.843s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0314e33e-851f-491e-8320-06ffa26dbafa tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1.67c9f555-251e-4d39-803f-2511a661c5cb {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:47 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1.67c9f555-251e-4d39-803f-2511a661c5cb Jun 04 06:35:47 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:47 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015 1073741824" returned: 0 in 0.917s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:47 devstack sudo[97722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015 Jun 04 06:35:47 devstack sudo[97722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:47 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0314e33e-851f-491e-8320-06ffa26dbafa tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1.67c9f555-251e-4d39-803f-2511a661c5cb" returned: 0 in 0.713s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:47 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0314e33e-851f-491e-8320-06ffa26dbafa tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-quobyte-67c9f555-251e-4d39-803f-2511a661c5cb" released by "_delete_snapshot" :: held 3.560s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:35:47 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0314e33e-851f-491e-8320-06ffa26dbafa tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-quobyte-56a08760-5686-43ee-aa09-446cd6b7a6f1" released by "delete_snapshot" :: held 3.586s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:35:48 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-0314e33e-851f-491e-8320-06ffa26dbafa tempest-VolumesSnapshotTestJSON-1399893733 None] Created reservations ['ec5b859e-1b5a-4932-8eac-98f1bc308f4c', 'b097072c-ec0c-444d-a16e-b824dedc6b0d', '9d170ba3-903f-4302-936b-4b6ea9198581', 'e3ab1b1c-a49c-4a48-8dce-ef55f19e2c29'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:35:48 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-0314e33e-851f-491e-8320-06ffa26dbafa tempest-VolumesSnapshotTestJSON-1399893733 None] Delete snapshot completed successfully. Jun 04 06:35:48 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0314e33e-851f-491e-8320-06ffa26dbafa tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-67c9f555-251e-4d39-803f-2511a661c5cb-delete_snapshot" released by "delete_snapshot" :: held 3.872s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:35:48 devstack sudo[97722]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015" returned: 0 in 0.701s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:48 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:35:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:35:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-efd0e23b-99f2-4e49-8e2b-4cfad31cf9c9 tempest-VolumesDeleteCascade-49272846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.629s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:35:48 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-efd0e23b-99f2-4e49-8e2b-4cfad31cf9c9 tempest-VolumesDeleteCascade-49272846 None] Creating offline snapshot 895c39b7-9488-4490-bcf1-d809f6100dd6 of volume a91eb1f9-9993-40fc-88de-7f39f7e35e54 {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:35:48 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a12eea3-9608-493a-bd64-596b4508a1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4446a4b3-b851-491a-9171-27372e269015', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:48 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14ef48db-155e-4dfc-8be4-0e5222763dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:48 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[218a8293-8ad0-4505-a811-4b7a1796bb25]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:35:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-efd0e23b-99f2-4e49-8e2b-4cfad31cf9c9 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:48 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] Volume volume-4446a4b3-b851-491a-9171-27372e269015 (4446a4b3-b851-491a-9171-27372e269015): created successfully Jun 04 06:35:48 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14ef48db-155e-4dfc-8be4-0e5222763dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:48 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] Flow 'volume_create_manager' (8f7df6fd-5479-4eaf-b7c1-c79ae6160a80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:35:48 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-9d79c81f-5f4f-4e0b-9af1-51c87d9ebd65 tempest-SnapshotDependencyTests-326068921 None] Created volume successfully. Jun 04 06:35:48 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54 Jun 04 06:35:48 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-580b9a3d-8cfc-45ad-9768-45ef387a29b2 tempest-SnapshotDependencyTests-326068921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:35:49 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:35:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] Flow 'volume_create_manager' (65a319d0-a001-4168-af5e-8f7d07b6abff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:35:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ac9ad68-da79-4f93-878b-ef3151f39a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ac9ad68-da79-4f93-878b-ef3151f39a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-598339148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3efeaf5c5c746c9b30246535ccbddd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:35:49Z,use_quota=True,user_id='c65b3028bde24d8da01c044e3ca0c87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39f0ba9e-3288-41e1-8465-01ee2c870c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39f0ba9e-3288-41e1-8465-01ee2c870c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afbb80bf-51a8-41a9-8107-ed9c62a22353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afbb80bf-51a8-41a9-8107-ed9c62a22353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e', 'volume_name': 'volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee6d3f0-19bf-40de-a21c-b21bb3c44550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee6d3f0-19bf-40de-a21c-b21bb3c44550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c3d95e-79df-4c3c-9cfc-ff70aabafc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:49 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] Volume 4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e', 'volume_size': 1} Jun 04 06:35:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:35:49 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-efd0e23b-99f2-4e49-8e2b-4cfad31cf9c9 tempest-VolumesDeleteCascade-49272846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54" returned: 0 in 1.032s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-efd0e23b-99f2-4e49-8e2b-4cfad31cf9c9 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54.895c39b7-9488-4490-bcf1-d809f6100dd6 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:49 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54.895c39b7-9488-4490-bcf1-d809f6100dd6 1G Jun 04 06:35:49 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:50 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-efd0e23b-99f2-4e49-8e2b-4cfad31cf9c9 tempest-VolumesDeleteCascade-49272846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54.895c39b7-9488-4490-bcf1-d809f6100dd6 1G" returned: 0 in 0.852s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-efd0e23b-99f2-4e49-8e2b-4cfad31cf9c9 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54.895c39b7-9488-4490-bcf1-d809f6100dd6 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:50 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54.895c39b7-9488-4490-bcf1-d809f6100dd6 Jun 04 06:35:50 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:50 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-efd0e23b-99f2-4e49-8e2b-4cfad31cf9c9 tempest-VolumesDeleteCascade-49272846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54.895c39b7-9488-4490-bcf1-d809f6100dd6" returned: 0 in 0.825s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:50 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-efd0e23b-99f2-4e49-8e2b-4cfad31cf9c9 tempest-VolumesDeleteCascade-49272846 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54.895c39b7-9488-4490-bcf1-d809f6100dd6 is being set with open permissions: ugo+rw Jun 04 06:35:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-efd0e23b-99f2-4e49-8e2b-4cfad31cf9c9 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54.895c39b7-9488-4490-bcf1-d809f6100dd6 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:50 devstack sudo[97743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54.895c39b7-9488-4490-bcf1-d809f6100dd6 Jun 04 06:35:50 devstack sudo[97743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:51 devstack sudo[97743]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-efd0e23b-99f2-4e49-8e2b-4cfad31cf9c9 tempest-VolumesDeleteCascade-49272846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54.895c39b7-9488-4490-bcf1-d809f6100dd6" returned: 0 in 0.665s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-efd0e23b-99f2-4e49-8e2b-4cfad31cf9c9 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:51 devstack sudo[97749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54.info Jun 04 06:35:51 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:52 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-efd0e23b-99f2-4e49-8e2b-4cfad31cf9c9 tempest-VolumesDeleteCascade-49272846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54.info" returned: 0 in 0.609s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:52 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-efd0e23b-99f2-4e49-8e2b-4cfad31cf9c9 tempest-VolumesDeleteCascade-49272846 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54.info is being set with open permissions: ugo+rw Jun 04 06:35:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-efd0e23b-99f2-4e49-8e2b-4cfad31cf9c9 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:52 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54.info Jun 04 06:35:52 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:52 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-efd0e23b-99f2-4e49-8e2b-4cfad31cf9c9 tempest-VolumesDeleteCascade-49272846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54.info" returned: 0 in 0.685s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-efd0e23b-99f2-4e49-8e2b-4cfad31cf9c9 tempest-VolumesDeleteCascade-49272846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.789s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:35:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-580b9a3d-8cfc-45ad-9768-45ef387a29b2 tempest-SnapshotDependencyTests-326068921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.130s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:35:53 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-580b9a3d-8cfc-45ad-9768-45ef387a29b2 tempest-SnapshotDependencyTests-326068921 None] Creating offline snapshot 186bfb9f-318d-4684-a0f4-091d6fda3171 of volume 4446a4b3-b851-491a-9171-27372e269015 {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:35:53 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-efd0e23b-99f2-4e49-8e2b-4cfad31cf9c9 tempest-VolumesDeleteCascade-49272846 None] Create snapshot completed successfully Jun 04 06:35:53 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a74b12-fafd-42ee-beab-af4dd33941f1]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:35:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-580b9a3d-8cfc-45ad-9768-45ef387a29b2 tempest-SnapshotDependencyTests-326068921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:53 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015 Jun 04 06:35:53 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:53 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-580b9a3d-8cfc-45ad-9768-45ef387a29b2 tempest-SnapshotDependencyTests-326068921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015" returned: 0 in 0.782s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-580b9a3d-8cfc-45ad-9768-45ef387a29b2 tempest-SnapshotDependencyTests-326068921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015.186bfb9f-318d-4684-a0f4-091d6fda3171 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:53 devstack sudo[97760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015.186bfb9f-318d-4684-a0f4-091d6fda3171 1G Jun 04 06:35:53 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-210107ec-431e-4c4d-9062-80aab47ddd91 req-da5ab9a1-2445-4189-a8b2-551aa2d60f40 tempest-AttachVolumeShelveTestJSON-2104168720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:35:54 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:35:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Flow 'volume_create_manager' (2ff89a3a-1d67-491a-8a79-a45af0fae9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:35:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed465b9-7616-45d0-b838-5ce8956c88bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed465b9-7616-45d0-b838-5ce8956c88bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-880283357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dec1b729-b999-4bbc-a59a-ab75d31aeff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee5ae49cd6794073a63af50335e87f30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=895c39b7-9488-4490-bcf1-d809f6100dd6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:35:55Z,use_quota=True,user_id='e61c9f3c8a6f4ffaa283f872f1c00103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c0a676c-e13e-49fe-8cef-f9dfce39654e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c0a676c-e13e-49fe-8cef-f9dfce39654e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af68a05f-1841-4e49-9ffa-7957146f4df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af68a05f-1841-4e49-9ffa-7957146f4df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dec1b729-b999-4bbc-a59a-ab75d31aeff7', 'volume_name': 'volume-dec1b729-b999-4bbc-a59a-ab75d31aeff7', 'volume_size': 1, 'snapshot_id': '895c39b7-9488-4490-bcf1-d809f6100dd6'}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:54 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (293ac616-2dca-4d57-8633-c5f8bb22840a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (293ac616-2dca-4d57-8633-c5f8bb22840a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c50ed1-1e0d-4b96-a6f7-a7365ed2cc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:54 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Volume dec1b729-b999-4bbc-a59a-ab75d31aeff7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dec1b729-b999-4bbc-a59a-ab75d31aeff7', 'volume_size': 1, 'snapshot_id': '895c39b7-9488-4490-bcf1-d809f6100dd6'} Jun 04 06:35:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-580b9a3d-8cfc-45ad-9768-45ef387a29b2 tempest-SnapshotDependencyTests-326068921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015.186bfb9f-318d-4684-a0f4-091d6fda3171 1G" returned: 0 in 0.892s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-580b9a3d-8cfc-45ad-9768-45ef387a29b2 tempest-SnapshotDependencyTests-326068921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4446a4b3-b851-491a-9171-27372e269015 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015.186bfb9f-318d-4684-a0f4-091d6fda3171 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:35:54 devstack sudo[97775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4446a4b3-b851-491a-9171-27372e269015 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015.186bfb9f-318d-4684-a0f4-091d6fda3171 Jun 04 06:35:54 devstack sudo[97775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:55 devstack sudo[97775]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-580b9a3d-8cfc-45ad-9768-45ef387a29b2 tempest-SnapshotDependencyTests-326068921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4446a4b3-b851-491a-9171-27372e269015 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015.186bfb9f-318d-4684-a0f4-091d6fda3171" returned: 0 in 0.687s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:55 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-580b9a3d-8cfc-45ad-9768-45ef387a29b2 tempest-SnapshotDependencyTests-326068921 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015.186bfb9f-318d-4684-a0f4-091d6fda3171 is being set with open permissions: ugo+rw Jun 04 06:35:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-580b9a3d-8cfc-45ad-9768-45ef387a29b2 tempest-SnapshotDependencyTests-326068921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015.186bfb9f-318d-4684-a0f4-091d6fda3171 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:55 devstack sudo[97780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015.186bfb9f-318d-4684-a0f4-091d6fda3171 Jun 04 06:35:55 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:55 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-580b9a3d-8cfc-45ad-9768-45ef387a29b2 tempest-SnapshotDependencyTests-326068921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015.186bfb9f-318d-4684-a0f4-091d6fda3171" returned: 0 in 0.593s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-580b9a3d-8cfc-45ad-9768-45ef387a29b2 tempest-SnapshotDependencyTests-326068921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:56 devstack sudo[97783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015.info Jun 04 06:35:56 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:56 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-580b9a3d-8cfc-45ad-9768-45ef387a29b2 tempest-SnapshotDependencyTests-326068921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015.info" returned: 0 in 0.576s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:56 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-580b9a3d-8cfc-45ad-9768-45ef387a29b2 tempest-SnapshotDependencyTests-326068921 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015.info is being set with open permissions: ugo+rw Jun 04 06:35:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-580b9a3d-8cfc-45ad-9768-45ef387a29b2 tempest-SnapshotDependencyTests-326068921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:56 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015.info Jun 04 06:35:56 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:57 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-580b9a3d-8cfc-45ad-9768-45ef387a29b2 tempest-SnapshotDependencyTests-326068921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015.info" returned: 0 in 0.620s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-580b9a3d-8cfc-45ad-9768-45ef387a29b2 tempest-SnapshotDependencyTests-326068921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.262s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:35:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.977s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:35:57 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-598339148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3efeaf5c5c746c9b30246535ccbddd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:35:49Z,use_quota=True,user_id='c65b3028bde24d8da01c044e3ca0c87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:35:57 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] Creating volume 4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:35:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:35:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:35:57 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:35:57 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:35:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:35:57 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:35:57 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:35:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:57 devstack sudo[97790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e 1073741824 Jun 04 06:35:57 devstack sudo[97790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:57 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-580b9a3d-8cfc-45ad-9768-45ef387a29b2 tempest-SnapshotDependencyTests-326068921 None] Create snapshot completed successfully Jun 04 06:35:58 devstack sudo[97790]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e 1073741824" returned: 0 in 0.871s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:58 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e Jun 04 06:35:58 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:58 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e" returned: 0 in 0.689s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:58 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:35:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:35:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-210107ec-431e-4c4d-9062-80aab47ddd91 req-da5ab9a1-2445-4189-a8b2-551aa2d60f40 tempest-AttachVolumeShelveTestJSON-2104168720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.742s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:35:58 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c3d95e-79df-4c3c-9cfc-ff70aabafc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:58 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8fbae65-ca2c-4067-b6c3-7f669bfc2b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:58 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[8174d7cb-9bf0-4268-a9c3-95e0caf7fc16]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:35:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-210107ec-431e-4c4d-9062-80aab47ddd91 req-da5ab9a1-2445-4189-a8b2-551aa2d60f40 tempest-AttachVolumeShelveTestJSON-2104168720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-04e84166-152f-49ef-b6fd-fcc3d8f00326 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:58 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] Volume volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e (4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e): created successfully Jun 04 06:35:58 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8fbae65-ca2c-4067-b6c3-7f669bfc2b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:58 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] Flow 'volume_create_manager' (65a319d0-a001-4168-af5e-8f7d07b6abff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:35:58 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:35:58 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-5affdaab-7b08-4c60-afea-90fb642b681e tempest-VolumesSnapshotTestJSON-1399893733 None] Created volume successfully. Jun 04 06:35:58 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Flow 'volume_create_manager' (2c725c29-bffd-4526-aca3-75e08de1f1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:35:59 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6114ca66-1569-4df4-9fa5-204a90713073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:59 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6114ca66-1569-4df4-9fa5-204a90713073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00a4468f-d465-44ee-8581-588494782b03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e95a2cf99b047db951ab8857bfd84ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=186bfb9f-318d-4684-a0f4-091d6fda3171,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:35:59Z,use_quota=True,user_id='4d5e82bef464429ba6aa96512c022fd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:59 devstack sudo[97799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-04e84166-152f-49ef-b6fd-fcc3d8f00326 Jun 04 06:35:59 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:35:59 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eaeb978-d25f-48a9-9f6b-3f35f25b25be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:59 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eaeb978-d25f-48a9-9f6b-3f35f25b25be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:59 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (854328e1-3772-405a-ad3c-8a15b3db69a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:59 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (854328e1-3772-405a-ad3c-8a15b3db69a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '00a4468f-d465-44ee-8581-588494782b03', 'volume_name': 'volume-00a4468f-d465-44ee-8581-588494782b03', 'volume_size': 1, 'snapshot_id': '186bfb9f-318d-4684-a0f4-091d6fda3171'}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:59 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d6687dc-2c15-4631-a909-f9460cff152d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:59 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d6687dc-2c15-4631-a909-f9460cff152d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:35:59 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a497f458-16a1-4f56-a584-a284551b051c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:35:59 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Volume 00a4468f-d465-44ee-8581-588494782b03: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-00a4468f-d465-44ee-8581-588494782b03', 'volume_size': 1, 'snapshot_id': '186bfb9f-318d-4684-a0f4-091d6fda3171'} Jun 04 06:35:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:35:59 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root Jun 04 06:35:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-210107ec-431e-4c4d-9062-80aab47ddd91 req-da5ab9a1-2445-4189-a8b2-551aa2d60f40 tempest-AttachVolumeShelveTestJSON-2104168720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-04e84166-152f-49ef-b6fd-fcc3d8f00326" returned: 0 in 0.781s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:35:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-210107ec-431e-4c4d-9062-80aab47ddd91 req-da5ab9a1-2445-4189-a8b2-551aa2d60f40 tempest-AttachVolumeShelveTestJSON-2104168720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.823s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:35:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.974s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:35:59 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Acquiring lock "cinder-quobyte-895c39b7-9488-4490-bcf1-d809f6100dd6-dec1b729-b999-4bbc-a59a-ab75d31aeff7" by "_create_volume_from_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:35:59 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Lock "cinder-quobyte-895c39b7-9488-4490-bcf1-d809f6100dd6-dec1b729-b999-4bbc-a59a-ab75d31aeff7" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:35:59 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Creating volume dec1b729-b999-4bbc-a59a-ab75d31aeff7 from snapshot 895c39b7-9488-4490-bcf1-d809f6100dd6 {{(pid=86069) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 04 06:35:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:35:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:35:59 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:35:59 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:35:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:35:59 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:35:59 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Acquiring lock "cinder-quobyte-dec1b729-b999-4bbc-a59a-ab75d31aeff7" by "_copy_volume_from_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:35:59 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Lock "cinder-quobyte-dec1b729-b999-4bbc-a59a-ab75d31aeff7" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:35:59 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] snapshot: 895c39b7-9488-4490-bcf1-d809f6100dd6, volume: dec1b729-b999-4bbc-a59a-ab75d31aeff7, {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 06:35:59 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-210107ec-431e-4c4d-9062-80aab47ddd91 req-da5ab9a1-2445-4189-a8b2-551aa2d60f40 tempest-AttachVolumeShelveTestJSON-2104168720 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574', 'name': 'volume-04e84166-152f-49ef-b6fd-fcc3d8f00326', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c5d1beeb-b6b6-4cb2-b67f-e3e05d4a9377', 'enforce_multipath': True} {{(pid=86069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 06:35:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:35:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:35:59 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:35:59 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:35:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:35:59 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d43a228-c8cd-4509-8491-487f1cd2b257]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:35:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54.895c39b7-9488-4490-bcf1-d809f6100dd6 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:35:59 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-210107ec-431e-4c4d-9062-80aab47ddd91 req-da5ab9a1-2445-4189-a8b2-551aa2d60f40 tempest-AttachVolumeShelveTestJSON-2104168720 None] attachment_update completed successfully. Jun 04 06:35:59 devstack sudo[97804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54.895c39b7-9488-4490-bcf1-d809f6100dd6 Jun 04 06:35:59 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-4d509cdc-443d-4215-a4b0-f5004e43685e tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:36:00 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54.895c39b7-9488-4490-bcf1-d809f6100dd6" returned: 0 in 0.806s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:00 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:36:00 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54 {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 06:36:00 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Creating direct copy from snapshot {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 06:36:00 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5589a8-c490-4c9d-a8ff-a27f3d666352]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:36:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:00 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54 Jun 04 06:36:00 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:01 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54" returned: 0 in 0.805s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:01 devstack cinder-volume[86069]: DEBUG cinder.utils [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Path /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dec1b729-b999-4bbc-a59a-ab75d31aeff7 not found in is_blk_device check {{(pid=86069) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 04 06:36:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dec1b729-b999-4bbc-a59a-ab75d31aeff7 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:01 devstack sudo[97814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dec1b729-b999-4bbc-a59a-ab75d31aeff7 Jun 04 06:36:01 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:07 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dec1b729-b999-4bbc-a59a-ab75d31aeff7" returned: 0 in 5.750s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:07 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[26502fd7-4e33-4cd2-ac13-5978161953f9]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:36:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:07 devstack sudo[97829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54 Jun 04 06:36:07 devstack sudo[97829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:08 devstack sudo[97829]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54" returned: 0 in 0.925s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:08 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Image conversion details: src /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54, size 1024.00 MB, duration 5.75 sec, destination /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dec1b729-b999-4bbc-a59a-ab75d31aeff7 {{(pid=86069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 06:36:08 devstack cinder-volume[86069]: INFO cinder.image.image_utils [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Converted 1024.00 MB image at 178.06 MB/s Jun 04 06:36:08 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dec1b729-b999-4bbc-a59a-ab75d31aeff7 is being set with open permissions: ugo+rw Jun 04 06:36:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dec1b729-b999-4bbc-a59a-ab75d31aeff7 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:08 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dec1b729-b999-4bbc-a59a-ab75d31aeff7 Jun 04 06:36:08 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:08 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dec1b729-b999-4bbc-a59a-ab75d31aeff7" returned: 0 in 0.590s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:08 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Lock "cinder-quobyte-dec1b729-b999-4bbc-a59a-ab75d31aeff7" released by "_copy_volume_from_snapshot" :: held 8.989s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:36:08 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Lock "cinder-quobyte-895c39b7-9488-4490-bcf1-d809f6100dd6-dec1b729-b999-4bbc-a59a-ab75d31aeff7" released by "_create_volume_from_snapshot" :: held 9.024s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:36:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.047s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:36:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 9.681s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:36:08 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Acquiring lock "cinder-quobyte-186bfb9f-318d-4684-a0f4-091d6fda3171-00a4468f-d465-44ee-8581-588494782b03" by "_create_volume_from_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:36:08 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Lock "cinder-quobyte-186bfb9f-318d-4684-a0f4-091d6fda3171-00a4468f-d465-44ee-8581-588494782b03" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:36:08 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Creating volume 00a4468f-d465-44ee-8581-588494782b03 from snapshot 186bfb9f-318d-4684-a0f4-091d6fda3171 {{(pid=86069) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 04 06:36:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:36:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:36:08 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:36:08 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:36:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:36:08 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:36:08 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Acquiring lock "cinder-quobyte-00a4468f-d465-44ee-8581-588494782b03" by "_copy_volume_from_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:36:08 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c50ed1-1e0d-4b96-a6f7-a7365ed2cc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dec1b729-b999-4bbc-a59a-ab75d31aeff7', 'volume_size': 1, 'snapshot_id': '895c39b7-9488-4490-bcf1-d809f6100dd6'}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:08 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dfd00d0-53c6-42a9-9e4d-5f4990237512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:08 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Lock "cinder-quobyte-00a4468f-d465-44ee-8581-588494782b03" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:36:08 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] snapshot: 186bfb9f-318d-4684-a0f4-091d6fda3171, volume: 00a4468f-d465-44ee-8581-588494782b03, {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 06:36:08 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Volume volume-dec1b729-b999-4bbc-a59a-ab75d31aeff7 (dec1b729-b999-4bbc-a59a-ab75d31aeff7): created successfully Jun 04 06:36:08 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dfd00d0-53c6-42a9-9e4d-5f4990237512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:08 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Flow 'volume_create_manager' (2ff89a3a-1d67-491a-8a79-a45af0fae9b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:36:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:36:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:36:08 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:36:08 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:36:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:36:08 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[a770a8f5-565e-4c80-aac8-e7721c906477]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:36:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015.186bfb9f-318d-4684-a0f4-091d6fda3171 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:08 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-ca3e64a3-ac6a-4e20-9e58-4e41d7daae11 tempest-VolumesDeleteCascade-49272846 None] Created volume successfully. Jun 04 06:36:08 devstack sudo[97837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015.186bfb9f-318d-4684-a0f4-091d6fda3171 Jun 04 06:36:08 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:09 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015.186bfb9f-318d-4684-a0f4-091d6fda3171" returned: 0 in 0.871s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:09 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4446a4b3-b851-491a-9171-27372e269015(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:36:09 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015 {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 06:36:09 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Creating direct copy from snapshot {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 06:36:09 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[d543caab-0aa5-4a28-a1f6-65b08017a390]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:36:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:09 devstack sudo[97842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015 Jun 04 06:36:09 devstack sudo[97842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:10 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Acquiring lock "cinder-a91eb1f9-9993-40fc-88de-7f39f7e35e54-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:36:10 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Lock "cinder-a91eb1f9-9993-40fc-88de-7f39f7e35e54-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:36:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Performing cascade delete. {{(pid=86069) delete_volume /opt/stack/cinder/cinder/volume/manager.py:996}} Jun 04 06:36:10 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Acquiring lock "cinder-895c39b7-9488-4490-bcf1-d809f6100dd6-delete_snapshot" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:36:10 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Lock "cinder-895c39b7-9488-4490-bcf1-d809f6100dd6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:36:10 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Acquiring lock "cinder-quobyte-a91eb1f9-9993-40fc-88de-7f39f7e35e54" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:36:10 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Lock "cinder-quobyte-a91eb1f9-9993-40fc-88de-7f39f7e35e54" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:36:10 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Acquiring lock "cinder-quobyte-895c39b7-9488-4490-bcf1-d809f6100dd6" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:36:10 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Lock "cinder-quobyte-895c39b7-9488-4490-bcf1-d809f6100dd6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:36:10 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Deleting offline snapshot 895c39b7-9488-4490-bcf1-d809f6100dd6 of volume a91eb1f9-9993-40fc-88de-7f39f7e35e54 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:36:10 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] snapshot_file for this snap is: volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54.895c39b7-9488-4490-bcf1-d809f6100dd6 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:36:10 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[2faee3c3-821a-4c6c-adbc-9a623d52c136]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:36:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54.895c39b7-9488-4490-bcf1-d809f6100dd6 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:10 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54.895c39b7-9488-4490-bcf1-d809f6100dd6 Jun 04 06:36:10 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:10 devstack sudo[97842]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015" returned: 0 in 0.933s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:10 devstack cinder-volume[86069]: DEBUG cinder.utils [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Path /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-00a4468f-d465-44ee-8581-588494782b03 not found in is_blk_device check {{(pid=86069) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 04 06:36:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-00a4468f-d465-44ee-8581-588494782b03 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:10 devstack sudo[97862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-00a4468f-d465-44ee-8581-588494782b03 Jun 04 06:36:10 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager._thread_info {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:36:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread count: 28 {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 06:36:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread info: [<_MainThread(MainThread, started 131797370544256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 06:36:11 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54.895c39b7-9488-4490-bcf1-d809f6100dd6" returned: 0 in 1.022s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:36:11 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ad0ddb-4dc9-4727-b703-8aff8e92f962]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:36:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:11 devstack sudo[97874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54 Jun 04 06:36:11 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:12 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54" returned: 0 in 1.299s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54.895c39b7-9488-4490-bcf1-d809f6100dd6 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:12 devstack sudo[97906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54.895c39b7-9488-4490-bcf1-d809f6100dd6 Jun 04 06:36:12 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:15 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54.895c39b7-9488-4490-bcf1-d809f6100dd6" returned: 0 in 2.339s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54.895c39b7-9488-4490-bcf1-d809f6100dd6 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:15 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54.895c39b7-9488-4490-bcf1-d809f6100dd6 Jun 04 06:36:15 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:16 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54.895c39b7-9488-4490-bcf1-d809f6100dd6" returned: 0 in 1.757s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:16 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Lock "cinder-quobyte-895c39b7-9488-4490-bcf1-d809f6100dd6" released by "_delete_snapshot" :: held 6.589s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:36:16 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Lock "cinder-quobyte-a91eb1f9-9993-40fc-88de-7f39f7e35e54" released by "delete_snapshot" :: held 6.630s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:36:17 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Created reservations ['461be1b4-fa29-4c15-bb20-6d9d5a0aff4d', '7ba22644-9c92-4955-a9a1-2c20936b02ad', '74aa22dd-10ab-4897-94ec-77cd71e04f20', '18ba420b-51ec-4f86-912e-42cf2a0ae879'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:36:17 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-00a4468f-d465-44ee-8581-588494782b03" returned: 0 in 6.418s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:17 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Delete snapshot completed successfully. Jun 04 06:36:17 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Lock "cinder-895c39b7-9488-4490-bcf1-d809f6100dd6-delete_snapshot" released by "delete_snapshot" :: held 6.899s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:36:17 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Snapshots deleted, issuing volume delete {{(pid=86069) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1011}} Jun 04 06:36:17 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Acquiring lock "cinder-quobyte-a91eb1f9-9993-40fc-88de-7f39f7e35e54" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:36:17 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[22944667-9e36-412e-ae79-1281f02ccf60]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:36:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:17 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Lock "cinder-quobyte-a91eb1f9-9993-40fc-88de-7f39f7e35e54" acquired by "delete_volume" :: waited 0.042s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:36:17 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb06826-453b-43c8-befd-5cfab0d85db7]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:36:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:17 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015 Jun 04 06:36:17 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:17 devstack sudo[97986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54 Jun 04 06:36:17 devstack sudo[97986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:18 devstack sudo[97986]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54" returned: 0 in 0.788s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:18 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54 Jun 04 06:36:18 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:18 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015" returned: 0 in 0.998s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:18 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Image conversion details: src /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015, size 1024.00 MB, duration 6.42 sec, destination /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-00a4468f-d465-44ee-8581-588494782b03 {{(pid=86069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 06:36:18 devstack cinder-volume[86069]: INFO cinder.image.image_utils [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Converted 1024.00 MB image at 159.51 MB/s Jun 04 06:36:18 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-00a4468f-d465-44ee-8581-588494782b03 is being set with open permissions: ugo+rw Jun 04 06:36:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-00a4468f-d465-44ee-8581-588494782b03 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:18 devstack sudo[97997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-00a4468f-d465-44ee-8581-588494782b03 Jun 04 06:36:18 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:18 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a91eb1f9-9993-40fc-88de-7f39f7e35e54" returned: 0 in 0.610s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:18 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Lock "cinder-quobyte-a91eb1f9-9993-40fc-88de-7f39f7e35e54" released by "delete_volume" :: held 1.506s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:36:18 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Created reservations ['8da70d3b-610d-48fd-8946-92d3fc248350', 'e81aa71a-e9c8-4818-bd01-efb2d8ea035b', 'cbc3276c-8033-466c-9391-c4253499845e', '782c8a33-e2d4-4606-b4a3-8118f60cfd18'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:36:18 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-00a4468f-d465-44ee-8581-588494782b03" returned: 0 in 0.650s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:18 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Lock "cinder-quobyte-00a4468f-d465-44ee-8581-588494782b03" released by "_copy_volume_from_snapshot" :: held 10.033s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:36:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:36:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:36:18 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:36:18 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:36:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:36:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:18 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Lock "cinder-quobyte-186bfb9f-318d-4684-a0f4-091d6fda3171-00a4468f-d465-44ee-8581-588494782b03" released by "_create_volume_from_snapshot" :: held 10.098s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:36:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.118s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:36:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-4d509cdc-443d-4215-a4b0-f5004e43685e tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 18.729s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:36:18 devstack sudo[98004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:36:18 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:18 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-4d509cdc-443d-4215-a4b0-f5004e43685e tempest-VolumesSnapshotTestJSON-1399893733 None] Creating offline snapshot d0200ae4-741d-4e0f-9af1-432b76f7dbf4 of volume 4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:36:18 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb73be5-8846-425a-8999-55cc348b5fe9]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:36:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4d509cdc-443d-4215-a4b0-f5004e43685e tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:18 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a497f458-16a1-4f56-a584-a284551b051c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00a4468f-d465-44ee-8581-588494782b03', 'volume_size': 1, 'snapshot_id': '186bfb9f-318d-4684-a0f4-091d6fda3171'}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:18 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72a4709f-eb8b-4dd6-b0a1-9e5900f43766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:19 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Volume volume-00a4468f-d465-44ee-8581-588494782b03 (00a4468f-d465-44ee-8581-588494782b03): created successfully Jun 04 06:36:19 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72a4709f-eb8b-4dd6-b0a1-9e5900f43766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:19 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Flow 'volume_create_manager' (2c725c29-bffd-4526-aca3-75e08de1f1dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:36:19 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-ca7d7162-3cd8-4765-bf48-a750f1386944 tempest-SnapshotDependencyTests-326068921 None] Created volume successfully. Jun 04 06:36:19 devstack sudo[98006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e Jun 04 06:36:19 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:19 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a9ee0d75-f7e1-40ed-be7d-94b95b7ff707 tempest-SnapshotDependencyTests-326068921 None] Acquiring lock "cinder-186bfb9f-318d-4684-a0f4-091d6fda3171-delete_snapshot" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:36:19 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a9ee0d75-f7e1-40ed-be7d-94b95b7ff707 tempest-SnapshotDependencyTests-326068921 None] Lock "cinder-186bfb9f-318d-4684-a0f4-091d6fda3171-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:36:19 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a9ee0d75-f7e1-40ed-be7d-94b95b7ff707 tempest-SnapshotDependencyTests-326068921 None] Acquiring lock "cinder-quobyte-4446a4b3-b851-491a-9171-27372e269015" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:36:19 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a9ee0d75-f7e1-40ed-be7d-94b95b7ff707 tempest-SnapshotDependencyTests-326068921 None] Lock "cinder-quobyte-4446a4b3-b851-491a-9171-27372e269015" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:36:19 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a9ee0d75-f7e1-40ed-be7d-94b95b7ff707 tempest-SnapshotDependencyTests-326068921 None] Acquiring lock "cinder-quobyte-186bfb9f-318d-4684-a0f4-091d6fda3171" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:36:19 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a9ee0d75-f7e1-40ed-be7d-94b95b7ff707 tempest-SnapshotDependencyTests-326068921 None] Lock "cinder-quobyte-186bfb9f-318d-4684-a0f4-091d6fda3171" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:36:19 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-a9ee0d75-f7e1-40ed-be7d-94b95b7ff707 tempest-SnapshotDependencyTests-326068921 None] Deleting offline snapshot 186bfb9f-318d-4684-a0f4-091d6fda3171 of volume 4446a4b3-b851-491a-9171-27372e269015 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:36:19 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-a9ee0d75-f7e1-40ed-be7d-94b95b7ff707 tempest-SnapshotDependencyTests-326068921 None] snapshot_file for this snap is: volume-4446a4b3-b851-491a-9171-27372e269015.186bfb9f-318d-4684-a0f4-091d6fda3171 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:36:19 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1b5d9d-1d47-4580-a46f-09005253b4b1]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:36:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a9ee0d75-f7e1-40ed-be7d-94b95b7ff707 tempest-SnapshotDependencyTests-326068921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015.186bfb9f-318d-4684-a0f4-091d6fda3171 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:19 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1650524e-88c1-4875-b14d-87ebfe6ab075 tempest-VolumesDeleteCascade-49272846 None] Acquiring lock "cinder-dec1b729-b999-4bbc-a59a-ab75d31aeff7-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:36:19 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1650524e-88c1-4875-b14d-87ebfe6ab075 tempest-VolumesDeleteCascade-49272846 None] Lock "cinder-dec1b729-b999-4bbc-a59a-ab75d31aeff7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:36:19 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1650524e-88c1-4875-b14d-87ebfe6ab075 tempest-VolumesDeleteCascade-49272846 None] Acquiring lock "cinder-quobyte-dec1b729-b999-4bbc-a59a-ab75d31aeff7" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:36:19 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.723s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:19 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:36:19 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1650524e-88c1-4875-b14d-87ebfe6ab075 tempest-VolumesDeleteCascade-49272846 None] Lock "cinder-quobyte-dec1b729-b999-4bbc-a59a-ab75d31aeff7" acquired by "delete_volume" :: waited 0.022s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:36:19 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Deleted volume successfully. Jun 04 06:36:19 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b73de5d-4eb4-47f9-94a3-8b33d9b075b6]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:36:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1650524e-88c1-4875-b14d-87ebfe6ab075 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dec1b729-b999-4bbc-a59a-ab75d31aeff7 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:19 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015.186bfb9f-318d-4684-a0f4-091d6fda3171 Jun 04 06:36:19 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:19 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-26b0fc4f-a2e0-4f5f-8019-08336fc26631 tempest-VolumesDeleteCascade-49272846 None] Lock "cinder-a91eb1f9-9993-40fc-88de-7f39f7e35e54-delete_volume" released by "delete_volume" :: held 9.500s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:36:19 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dec1b729-b999-4bbc-a59a-ab75d31aeff7 Jun 04 06:36:19 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:19 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4d509cdc-443d-4215-a4b0-f5004e43685e tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e" returned: 0 in 1.011s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4d509cdc-443d-4215-a4b0-f5004e43685e tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e.d0200ae4-741d-4e0f-9af1-432b76f7dbf4 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:20 devstack sudo[98020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e.d0200ae4-741d-4e0f-9af1-432b76f7dbf4 1G Jun 04 06:36:20 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:20 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a9ee0d75-f7e1-40ed-be7d-94b95b7ff707 tempest-SnapshotDependencyTests-326068921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015.186bfb9f-318d-4684-a0f4-091d6fda3171" returned: 0 in 1.150s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:20 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-a9ee0d75-f7e1-40ed-be7d-94b95b7ff707 tempest-SnapshotDependencyTests-326068921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4446a4b3-b851-491a-9171-27372e269015(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:36:20 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f96f88-db86-4020-9d6e-17df67d1f02b]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:36:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a9ee0d75-f7e1-40ed-be7d-94b95b7ff707 tempest-SnapshotDependencyTests-326068921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:20 devstack sudo[98384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015 Jun 04 06:36:20 devstack sudo[98384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:20 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1650524e-88c1-4875-b14d-87ebfe6ab075 tempest-VolumesDeleteCascade-49272846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dec1b729-b999-4bbc-a59a-ab75d31aeff7" returned: 0 in 1.223s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1650524e-88c1-4875-b14d-87ebfe6ab075 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dec1b729-b999-4bbc-a59a-ab75d31aeff7 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:20 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dec1b729-b999-4bbc-a59a-ab75d31aeff7 Jun 04 06:36:20 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:21 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4d509cdc-443d-4215-a4b0-f5004e43685e tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e.d0200ae4-741d-4e0f-9af1-432b76f7dbf4 1G" returned: 0 in 1.592s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4d509cdc-443d-4215-a4b0-f5004e43685e tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e.d0200ae4-741d-4e0f-9af1-432b76f7dbf4 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:21 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e.d0200ae4-741d-4e0f-9af1-432b76f7dbf4 Jun 04 06:36:21 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:21 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1650524e-88c1-4875-b14d-87ebfe6ab075 tempest-VolumesDeleteCascade-49272846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dec1b729-b999-4bbc-a59a-ab75d31aeff7" returned: 0 in 0.956s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:21 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1650524e-88c1-4875-b14d-87ebfe6ab075 tempest-VolumesDeleteCascade-49272846 None] Lock "cinder-quobyte-dec1b729-b999-4bbc-a59a-ab75d31aeff7" released by "delete_volume" :: held 2.254s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:36:21 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=76,cinder:UPDATE=68,cinder:DELETE=6,cinder:INSERT=17 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:36:21 devstack sudo[98384]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a9ee0d75-f7e1-40ed-be7d-94b95b7ff707 tempest-SnapshotDependencyTests-326068921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015" returned: 0 in 1.229s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a9ee0d75-f7e1-40ed-be7d-94b95b7ff707 tempest-SnapshotDependencyTests-326068921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015.186bfb9f-318d-4684-a0f4-091d6fda3171 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:21 devstack sudo[98414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015.186bfb9f-318d-4684-a0f4-091d6fda3171 Jun 04 06:36:21 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:21 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-1650524e-88c1-4875-b14d-87ebfe6ab075 tempest-VolumesDeleteCascade-49272846 None] Created reservations ['0d77c768-d24c-4d2b-972a-d7f1611553db', '78d44795-fbc5-429a-a9eb-e535965cdc20', 'c9af64f9-5baa-47e4-9fb5-26f88cf00e8f', 'e8b56e2b-0147-4204-b06d-1a7881394a06'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:36:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-1650524e-88c1-4875-b14d-87ebfe6ab075 tempest-VolumesDeleteCascade-49272846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:36:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-1650524e-88c1-4875-b14d-87ebfe6ab075 tempest-VolumesDeleteCascade-49272846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:36:22 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-1650524e-88c1-4875-b14d-87ebfe6ab075 tempest-VolumesDeleteCascade-49272846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:36:22 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-1650524e-88c1-4875-b14d-87ebfe6ab075 tempest-VolumesDeleteCascade-49272846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:36:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-1650524e-88c1-4875-b14d-87ebfe6ab075 tempest-VolumesDeleteCascade-49272846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:36:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1650524e-88c1-4875-b14d-87ebfe6ab075 tempest-VolumesDeleteCascade-49272846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:22 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:36:22 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:22 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4d509cdc-443d-4215-a4b0-f5004e43685e tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e.d0200ae4-741d-4e0f-9af1-432b76f7dbf4" returned: 0 in 1.058s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:22 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-4d509cdc-443d-4215-a4b0-f5004e43685e tempest-VolumesSnapshotTestJSON-1399893733 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e.d0200ae4-741d-4e0f-9af1-432b76f7dbf4 is being set with open permissions: ugo+rw Jun 04 06:36:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4d509cdc-443d-4215-a4b0-f5004e43685e tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e.d0200ae4-741d-4e0f-9af1-432b76f7dbf4 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:22 devstack sudo[98422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e.d0200ae4-741d-4e0f-9af1-432b76f7dbf4 Jun 04 06:36:22 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:22 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a9ee0d75-f7e1-40ed-be7d-94b95b7ff707 tempest-SnapshotDependencyTests-326068921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015.186bfb9f-318d-4684-a0f4-091d6fda3171" returned: 0 in 1.063s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a9ee0d75-f7e1-40ed-be7d-94b95b7ff707 tempest-SnapshotDependencyTests-326068921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015.186bfb9f-318d-4684-a0f4-091d6fda3171 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:23 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015.186bfb9f-318d-4684-a0f4-091d6fda3171 Jun 04 06:36:23 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:23 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1650524e-88c1-4875-b14d-87ebfe6ab075 tempest-VolumesDeleteCascade-49272846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.254s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:23 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-1650524e-88c1-4875-b14d-87ebfe6ab075 tempest-VolumesDeleteCascade-49272846 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:36:23 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-1650524e-88c1-4875-b14d-87ebfe6ab075 tempest-VolumesDeleteCascade-49272846 None] Deleted volume successfully. Jun 04 06:36:23 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1650524e-88c1-4875-b14d-87ebfe6ab075 tempest-VolumesDeleteCascade-49272846 None] Lock "cinder-dec1b729-b999-4bbc-a59a-ab75d31aeff7-delete_volume" released by "delete_volume" :: held 4.027s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:36:23 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4d509cdc-443d-4215-a4b0-f5004e43685e tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e.d0200ae4-741d-4e0f-9af1-432b76f7dbf4" returned: 0 in 0.937s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4d509cdc-443d-4215-a4b0-f5004e43685e tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:23 devstack sudo[98433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e.info Jun 04 06:36:23 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:24 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a9ee0d75-f7e1-40ed-be7d-94b95b7ff707 tempest-SnapshotDependencyTests-326068921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015.186bfb9f-318d-4684-a0f4-091d6fda3171" returned: 0 in 1.115s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:24 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a9ee0d75-f7e1-40ed-be7d-94b95b7ff707 tempest-SnapshotDependencyTests-326068921 None] Lock "cinder-quobyte-186bfb9f-318d-4684-a0f4-091d6fda3171" released by "_delete_snapshot" :: held 4.753s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:36:24 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a9ee0d75-f7e1-40ed-be7d-94b95b7ff707 tempest-SnapshotDependencyTests-326068921 None] Lock "cinder-quobyte-4446a4b3-b851-491a-9171-27372e269015" released by "delete_snapshot" :: held 4.812s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:36:24 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-a9ee0d75-f7e1-40ed-be7d-94b95b7ff707 tempest-SnapshotDependencyTests-326068921 None] Created reservations ['cf49151d-b113-4ea0-91ae-a5b53b8aefd4', 'd5b52408-e4f0-497d-928c-ba8c956f3f55', '3bf02d57-2229-4a16-8684-ccfbef529725', 'beaebfab-33ed-4be5-aa50-4568072af461'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:36:24 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-a9ee0d75-f7e1-40ed-be7d-94b95b7ff707 tempest-SnapshotDependencyTests-326068921 None] Delete snapshot completed successfully. Jun 04 06:36:24 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a9ee0d75-f7e1-40ed-be7d-94b95b7ff707 tempest-SnapshotDependencyTests-326068921 None] Lock "cinder-186bfb9f-318d-4684-a0f4-091d6fda3171-delete_snapshot" released by "delete_snapshot" :: held 5.058s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:36:24 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4d509cdc-443d-4215-a4b0-f5004e43685e tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e.info" returned: 0 in 0.880s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:24 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-4d509cdc-443d-4215-a4b0-f5004e43685e tempest-VolumesSnapshotTestJSON-1399893733 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e.info is being set with open permissions: ugo+rw Jun 04 06:36:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4d509cdc-443d-4215-a4b0-f5004e43685e tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:24 devstack sudo[98437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e.info Jun 04 06:36:24 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:24 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9a0b51c5-665a-4bef-aa88-afa218bfc919 tempest-SnapshotDependencyTests-326068921 None] Acquiring lock "cinder-4446a4b3-b851-491a-9171-27372e269015-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:36:24 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9a0b51c5-665a-4bef-aa88-afa218bfc919 tempest-SnapshotDependencyTests-326068921 None] Lock "cinder-4446a4b3-b851-491a-9171-27372e269015-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:36:24 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9a0b51c5-665a-4bef-aa88-afa218bfc919 tempest-SnapshotDependencyTests-326068921 None] Acquiring lock "cinder-quobyte-4446a4b3-b851-491a-9171-27372e269015" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:36:24 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9a0b51c5-665a-4bef-aa88-afa218bfc919 tempest-SnapshotDependencyTests-326068921 None] Lock "cinder-quobyte-4446a4b3-b851-491a-9171-27372e269015" acquired by "delete_volume" :: waited 0.037s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:36:24 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf4ae23-cd7c-46cc-bae7-ae851e70851d]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:36:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9a0b51c5-665a-4bef-aa88-afa218bfc919 tempest-SnapshotDependencyTests-326068921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:25 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015 Jun 04 06:36:25 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:25 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4d509cdc-443d-4215-a4b0-f5004e43685e tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e.info" returned: 0 in 0.837s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-4d509cdc-443d-4215-a4b0-f5004e43685e tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.523s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:36:25 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-4d509cdc-443d-4215-a4b0-f5004e43685e tempest-VolumesSnapshotTestJSON-1399893733 None] Create snapshot completed successfully Jun 04 06:36:25 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9a0b51c5-665a-4bef-aa88-afa218bfc919 tempest-SnapshotDependencyTests-326068921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015" returned: 0 in 1.001s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9a0b51c5-665a-4bef-aa88-afa218bfc919 tempest-SnapshotDependencyTests-326068921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:26 devstack sudo[98445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015 Jun 04 06:36:26 devstack sudo[98445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Flow 'volume_create_manager' (6132cf45-998b-4a95-98de-248ced29c6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae2031c-d90a-494d-818c-03a9eea3d8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae2031c-d90a-494d-818c-03a9eea3d8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1817830905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=286ca578-9c0f-4ac0-9009-06f3079337b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3efeaf5c5c746c9b30246535ccbddd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:36:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=d0200ae4-741d-4e0f-9af1-432b76f7dbf4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:36:26Z,use_quota=True,user_id='c65b3028bde24d8da01c044e3ca0c87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34044e63-3f17-48a3-9dd4-b569ab28f9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34044e63-3f17-48a3-9dd4-b569ab28f9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b566fa8-6414-4c56-8cf4-c2cdd1f95870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b566fa8-6414-4c56-8cf4-c2cdd1f95870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '286ca578-9c0f-4ac0-9009-06f3079337b2', 'volume_name': 'volume-286ca578-9c0f-4ac0-9009-06f3079337b2', 'volume_size': 2, 'snapshot_id': 'd0200ae4-741d-4e0f-9af1-432b76f7dbf4'}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbbff34f-00dc-4831-bff0-c95fb2c75c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbbff34f-00dc-4831-bff0-c95fb2c75c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ebacb14-0548-433e-8397-71e22c759ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:26 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Volume 286ca578-9c0f-4ac0-9009-06f3079337b2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-286ca578-9c0f-4ac0-9009-06f3079337b2', 'volume_size': 2, 'snapshot_id': 'd0200ae4-741d-4e0f-9af1-432b76f7dbf4'} Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "cinder-quobyte-d0200ae4-741d-4e0f-9af1-432b76f7dbf4-286ca578-9c0f-4ac0-9009-06f3079337b2" by "_create_volume_from_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-quobyte-d0200ae4-741d-4e0f-9af1-432b76f7dbf4-286ca578-9c0f-4ac0-9009-06f3079337b2" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Creating volume 286ca578-9c0f-4ac0-9009-06f3079337b2 from snapshot d0200ae4-741d-4e0f-9af1-432b76f7dbf4 {{(pid=86069) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "cinder-quobyte-286ca578-9c0f-4ac0-9009-06f3079337b2" by "_copy_volume_from_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-quobyte-286ca578-9c0f-4ac0-9009-06f3079337b2" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] snapshot: d0200ae4-741d-4e0f-9af1-432b76f7dbf4, volume: 286ca578-9c0f-4ac0-9009-06f3079337b2, {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe42ec2-737b-4e5e-b8cb-b7f844c98a98]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e.d0200ae4-741d-4e0f-9af1-432b76f7dbf4 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:26 devstack sudo[98445]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9a0b51c5-665a-4bef-aa88-afa218bfc919 tempest-SnapshotDependencyTests-326068921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4446a4b3-b851-491a-9171-27372e269015" returned: 0 in 0.918s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9a0b51c5-665a-4bef-aa88-afa218bfc919 tempest-SnapshotDependencyTests-326068921 None] Lock "cinder-quobyte-4446a4b3-b851-491a-9171-27372e269015" released by "delete_volume" :: held 1.999s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:36:26 devstack sudo[98449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e.d0200ae4-741d-4e0f-9af1-432b76f7dbf4 Jun 04 06:36:26 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:26 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-9a0b51c5-665a-4bef-aa88-afa218bfc919 tempest-SnapshotDependencyTests-326068921 None] Created reservations ['5242da9f-327a-4753-a792-0f6a68888fc7', '2cf7a278-0f3d-4745-8ef1-6e7d10d599e7', '57da42c6-a6e6-4e61-a0e1-dcffcc278cd0', 'a0a17f5f-7b43-4ab2-95e3-b051d28ca0ab'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:36:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9a0b51c5-665a-4bef-aa88-afa218bfc919 tempest-SnapshotDependencyTests-326068921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:36:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9a0b51c5-665a-4bef-aa88-afa218bfc919 tempest-SnapshotDependencyTests-326068921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:36:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-9a0b51c5-665a-4bef-aa88-afa218bfc919 tempest-SnapshotDependencyTests-326068921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:36:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-9a0b51c5-665a-4bef-aa88-afa218bfc919 tempest-SnapshotDependencyTests-326068921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:36:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9a0b51c5-665a-4bef-aa88-afa218bfc919 tempest-SnapshotDependencyTests-326068921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:36:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9a0b51c5-665a-4bef-aa88-afa218bfc919 tempest-SnapshotDependencyTests-326068921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:27 devstack sudo[98451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:36:27 devstack sudo[98451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-74d6f796-a1ad-4532-ba44-bbb5c568aa96 tempest-SnapshotDependencyTests-326068921 None] Acquiring lock "cinder-00a4468f-d465-44ee-8581-588494782b03-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:36:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-74d6f796-a1ad-4532-ba44-bbb5c568aa96 tempest-SnapshotDependencyTests-326068921 None] Lock "cinder-00a4468f-d465-44ee-8581-588494782b03-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:36:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-74d6f796-a1ad-4532-ba44-bbb5c568aa96 tempest-SnapshotDependencyTests-326068921 None] Acquiring lock "cinder-quobyte-00a4468f-d465-44ee-8581-588494782b03" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:36:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-74d6f796-a1ad-4532-ba44-bbb5c568aa96 tempest-SnapshotDependencyTests-326068921 None] Lock "cinder-quobyte-00a4468f-d465-44ee-8581-588494782b03" acquired by "delete_volume" :: waited 0.035s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:36:27 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[7880d1fd-9d81-44fc-b592-6264165336b8]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:36:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-74d6f796-a1ad-4532-ba44-bbb5c568aa96 tempest-SnapshotDependencyTests-326068921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-00a4468f-d465-44ee-8581-588494782b03 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:27 devstack sudo[98453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-00a4468f-d465-44ee-8581-588494782b03 Jun 04 06:36:27 devstack sudo[98453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:27 devstack sudo[98451]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9a0b51c5-665a-4bef-aa88-afa218bfc919 tempest-SnapshotDependencyTests-326068921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.832s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:27 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-9a0b51c5-665a-4bef-aa88-afa218bfc919 tempest-SnapshotDependencyTests-326068921 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:36:27 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-9a0b51c5-665a-4bef-aa88-afa218bfc919 tempest-SnapshotDependencyTests-326068921 None] Deleted volume successfully. Jun 04 06:36:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9a0b51c5-665a-4bef-aa88-afa218bfc919 tempest-SnapshotDependencyTests-326068921 None] Lock "cinder-4446a4b3-b851-491a-9171-27372e269015-delete_volume" released by "delete_volume" :: held 3.146s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:36:28 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e.d0200ae4-741d-4e0f-9af1-432b76f7dbf4" returned: 0 in 1.300s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:28 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:36:28 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 06:36:28 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Creating direct copy from snapshot {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 06:36:28 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[b633d60e-2c49-4563-b242-f477bf5b2fd8]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:36:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:28 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e Jun 04 06:36:28 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:28 devstack sudo[98453]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-74d6f796-a1ad-4532-ba44-bbb5c568aa96 tempest-SnapshotDependencyTests-326068921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-00a4468f-d465-44ee-8581-588494782b03" returned: 0 in 1.344s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-74d6f796-a1ad-4532-ba44-bbb5c568aa96 tempest-SnapshotDependencyTests-326068921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-00a4468f-d465-44ee-8581-588494782b03 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:28 devstack sudo[98498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-00a4468f-d465-44ee-8581-588494782b03 Jun 04 06:36:28 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:29 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e" returned: 0 in 1.048s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:29 devstack cinder-volume[86069]: DEBUG cinder.utils [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Path /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-286ca578-9c0f-4ac0-9009-06f3079337b2 not found in is_blk_device check {{(pid=86069) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 04 06:36:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-286ca578-9c0f-4ac0-9009-06f3079337b2 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:29 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-286ca578-9c0f-4ac0-9009-06f3079337b2 Jun 04 06:36:29 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:29 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:36:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] Flow 'volume_create_manager' (eece3c37-f4ad-41b1-b332-3ce3e190e48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:36:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b41a869-225c-46c7-9e1b-424d5e2de25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b41a869-225c-46c7-9e1b-424d5e2de25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1594897771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21d0bafc-1aa0-4f89-95de-be1195165a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33766f13991447ad832365d97bde3bf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:36:29Z,use_quota=True,user_id='176844a6c14442d1beaf1368b66e9915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (582ca339-08a5-45e2-8d5f-3f0a6ef5539b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (582ca339-08a5-45e2-8d5f-3f0a6ef5539b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b87412a-a1ab-477c-b40b-0130ad7ea67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b87412a-a1ab-477c-b40b-0130ad7ea67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21d0bafc-1aa0-4f89-95de-be1195165a22', 'volume_name': 'volume-21d0bafc-1aa0-4f89-95de-be1195165a22', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bc225c9-669a-40d5-81e2-405505870901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bc225c9-669a-40d5-81e2-405505870901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab40f65-bb41-4890-aa1f-9c8f07d6d789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:29 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] Volume 21d0bafc-1aa0-4f89-95de-be1195165a22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21d0bafc-1aa0-4f89-95de-be1195165a22', 'volume_size': 1} Jun 04 06:36:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:36:29 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-74d6f796-a1ad-4532-ba44-bbb5c568aa96 tempest-SnapshotDependencyTests-326068921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-00a4468f-d465-44ee-8581-588494782b03" returned: 0 in 0.970s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:29 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-74d6f796-a1ad-4532-ba44-bbb5c568aa96 tempest-SnapshotDependencyTests-326068921 None] Lock "cinder-quobyte-00a4468f-d465-44ee-8581-588494782b03" released by "delete_volume" :: held 2.367s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:36:29 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-74d6f796-a1ad-4532-ba44-bbb5c568aa96 tempest-SnapshotDependencyTests-326068921 None] Created reservations ['8ecdd398-e53e-4ad5-8918-7a8bb98c36ad', '23426abf-2251-4bf0-9034-6381c1f048e8', 'eb658533-3183-40fd-b8e5-111f1bf0e2c5', '55f49764-8a38-4f3e-bf08-996aa153aafb'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:36:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-74d6f796-a1ad-4532-ba44-bbb5c568aa96 tempest-SnapshotDependencyTests-326068921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:36:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-74d6f796-a1ad-4532-ba44-bbb5c568aa96 tempest-SnapshotDependencyTests-326068921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:36:29 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-74d6f796-a1ad-4532-ba44-bbb5c568aa96 tempest-SnapshotDependencyTests-326068921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:36:29 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-74d6f796-a1ad-4532-ba44-bbb5c568aa96 tempest-SnapshotDependencyTests-326068921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:36:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-74d6f796-a1ad-4532-ba44-bbb5c568aa96 tempest-SnapshotDependencyTests-326068921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:36:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-74d6f796-a1ad-4532-ba44-bbb5c568aa96 tempest-SnapshotDependencyTests-326068921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:29 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:36:29 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:31 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-74d6f796-a1ad-4532-ba44-bbb5c568aa96 tempest-SnapshotDependencyTests-326068921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.646s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:31 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-74d6f796-a1ad-4532-ba44-bbb5c568aa96 tempest-SnapshotDependencyTests-326068921 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:36:31 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-74d6f796-a1ad-4532-ba44-bbb5c568aa96 tempest-SnapshotDependencyTests-326068921 None] Deleted volume successfully. Jun 04 06:36:31 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-74d6f796-a1ad-4532-ba44-bbb5c568aa96 tempest-SnapshotDependencyTests-326068921 None] Lock "cinder-00a4468f-d465-44ee-8581-588494782b03-delete_volume" released by "delete_volume" :: held 4.303s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:36:35 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-286ca578-9c0f-4ac0-9009-06f3079337b2" returned: 0 in 6.254s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:35 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[3278b7ec-3691-4199-a66a-980fe2e1f6c8]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:36:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:35 devstack sudo[98529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e Jun 04 06:36:35 devstack sudo[98529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:36 devstack sudo[98529]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e" returned: 0 in 0.987s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:36 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Image conversion details: src /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e, size 1024.00 MB, duration 6.25 sec, destination /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-286ca578-9c0f-4ac0-9009-06f3079337b2 {{(pid=86069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 06:36:36 devstack cinder-volume[86069]: INFO cinder.image.image_utils [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Converted 1024.00 MB image at 163.71 MB/s Jun 04 06:36:36 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-286ca578-9c0f-4ac0-9009-06f3079337b2 is being set with open permissions: ugo+rw Jun 04 06:36:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-286ca578-9c0f-4ac0-9009-06f3079337b2 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:36 devstack sudo[98540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-286ca578-9c0f-4ac0-9009-06f3079337b2 Jun 04 06:36:36 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:37 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-286ca578-9c0f-4ac0-9009-06f3079337b2" returned: 0 in 0.730s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:37 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-quobyte-286ca578-9c0f-4ac0-9009-06f3079337b2" released by "_copy_volume_from_snapshot" :: held 10.456s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:36:37 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-quobyte-d0200ae4-741d-4e0f-9af1-432b76f7dbf4-286ca578-9c0f-4ac0-9009-06f3079337b2" released by "_create_volume_from_snapshot" :: held 10.508s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:36:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.536s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:36:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.498s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:36:37 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1594897771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21d0bafc-1aa0-4f89-95de-be1195165a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33766f13991447ad832365d97bde3bf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:36:29Z,use_quota=True,user_id='176844a6c14442d1beaf1368b66e9915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:36:37 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] Creating volume 21d0bafc-1aa0-4f89-95de-be1195165a22 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:36:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:36:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:36:37 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:36:37 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:36:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:36:37 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:36:37 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:36:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-21d0bafc-1aa0-4f89-95de-be1195165a22 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:37 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-21d0bafc-1aa0-4f89-95de-be1195165a22 1073741824 Jun 04 06:36:37 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ebacb14-0548-433e-8397-71e22c759ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-286ca578-9c0f-4ac0-9009-06f3079337b2', 'volume_size': 2, 'snapshot_id': 'd0200ae4-741d-4e0f-9af1-432b76f7dbf4'}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e152b991-9aa7-46b1-97d0-b6f0740d35f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:37 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Volume volume-286ca578-9c0f-4ac0-9009-06f3079337b2 (286ca578-9c0f-4ac0-9009-06f3079337b2): created successfully Jun 04 06:36:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e152b991-9aa7-46b1-97d0-b6f0740d35f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Flow 'volume_create_manager' (6132cf45-998b-4a95-98de-248ced29c6d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:36:37 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-f4b6277f-80fe-4c62-8edb-6d9f6be18102 tempest-VolumesSnapshotTestJSON-1399893733 None] Created volume successfully. Jun 04 06:36:37 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-476b789f-5c76-4ab2-9dbe-138f3d5959af tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "cinder-286ca578-9c0f-4ac0-9009-06f3079337b2-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:36:37 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-476b789f-5c76-4ab2-9dbe-138f3d5959af tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-286ca578-9c0f-4ac0-9009-06f3079337b2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:36:37 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-476b789f-5c76-4ab2-9dbe-138f3d5959af tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "cinder-quobyte-286ca578-9c0f-4ac0-9009-06f3079337b2" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:36:37 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-476b789f-5c76-4ab2-9dbe-138f3d5959af tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-quobyte-286ca578-9c0f-4ac0-9009-06f3079337b2" acquired by "delete_volume" :: waited 0.024s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:36:37 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[0992844b-d8b6-4087-8859-9cf6efa6133a]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:36:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-476b789f-5c76-4ab2-9dbe-138f3d5959af tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-286ca578-9c0f-4ac0-9009-06f3079337b2 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:38 devstack sudo[98579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-286ca578-9c0f-4ac0-9009-06f3079337b2 Jun 04 06:36:38 devstack sudo[98579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:38 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-21d0bafc-1aa0-4f89-95de-be1195165a22 1073741824" returned: 0 in 1.013s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-21d0bafc-1aa0-4f89-95de-be1195165a22 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:38 devstack sudo[98581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-21d0bafc-1aa0-4f89-95de-be1195165a22 Jun 04 06:36:38 devstack sudo[98581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:38 devstack sudo[98579]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-476b789f-5c76-4ab2-9dbe-138f3d5959af tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-286ca578-9c0f-4ac0-9009-06f3079337b2" returned: 0 in 0.818s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-476b789f-5c76-4ab2-9dbe-138f3d5959af tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-286ca578-9c0f-4ac0-9009-06f3079337b2 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:38 devstack sudo[98587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-286ca578-9c0f-4ac0-9009-06f3079337b2 Jun 04 06:36:38 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:38 devstack sudo[98581]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-21d0bafc-1aa0-4f89-95de-be1195165a22" returned: 0 in 0.707s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:38 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:36:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.791s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:36:38 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab40f65-bb41-4890-aa1f-9c8f07d6d789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21d0bafc-1aa0-4f89-95de-be1195165a22', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:38 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06ea2f43-6096-488e-bdb5-478339f2df8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:38 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] Volume volume-21d0bafc-1aa0-4f89-95de-be1195165a22 (21d0bafc-1aa0-4f89-95de-be1195165a22): created successfully Jun 04 06:36:38 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06ea2f43-6096-488e-bdb5-478339f2df8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:38 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] Flow 'volume_create_manager' (eece3c37-f4ad-41b1-b332-3ce3e190e48a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:36:39 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-f5295fd6-82a6-4164-99d6-3b5096c2e84d tempest-VolumesTransfersTest-214173969 None] Created volume successfully. Jun 04 06:36:39 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-476b789f-5c76-4ab2-9dbe-138f3d5959af tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-286ca578-9c0f-4ac0-9009-06f3079337b2" returned: 0 in 0.655s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-476b789f-5c76-4ab2-9dbe-138f3d5959af tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-quobyte-286ca578-9c0f-4ac0-9009-06f3079337b2" released by "delete_volume" :: held 1.525s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:36:39 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-476b789f-5c76-4ab2-9dbe-138f3d5959af tempest-VolumesSnapshotTestJSON-1399893733 None] Created reservations ['33f13986-4312-4fd7-8812-91c985e9627b', '02f6e243-7fa0-4d21-9ac0-e702ad532b99', 'b3975711-8769-4a59-aa81-18fae46c9913', '6c88d9ee-9bc3-49e7-b97a-00990814a6ce'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:36:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-476b789f-5c76-4ab2-9dbe-138f3d5959af tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:36:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-476b789f-5c76-4ab2-9dbe-138f3d5959af tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:36:39 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-476b789f-5c76-4ab2-9dbe-138f3d5959af tempest-VolumesSnapshotTestJSON-1399893733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:36:39 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-476b789f-5c76-4ab2-9dbe-138f3d5959af tempest-VolumesSnapshotTestJSON-1399893733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:36:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-476b789f-5c76-4ab2-9dbe-138f3d5959af tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:36:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-476b789f-5c76-4ab2-9dbe-138f3d5959af tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:39 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:36:39 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:40 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4c0d4b61-237d-4625-b260-7b2c7ba9a582 tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "cinder-d0200ae4-741d-4e0f-9af1-432b76f7dbf4-delete_snapshot" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:36:40 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4c0d4b61-237d-4625-b260-7b2c7ba9a582 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-d0200ae4-741d-4e0f-9af1-432b76f7dbf4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:36:40 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4c0d4b61-237d-4625-b260-7b2c7ba9a582 tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "cinder-quobyte-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:36:40 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4c0d4b61-237d-4625-b260-7b2c7ba9a582 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-quobyte-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:36:40 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4c0d4b61-237d-4625-b260-7b2c7ba9a582 tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "cinder-quobyte-d0200ae4-741d-4e0f-9af1-432b76f7dbf4" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:36:40 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4c0d4b61-237d-4625-b260-7b2c7ba9a582 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-quobyte-d0200ae4-741d-4e0f-9af1-432b76f7dbf4" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:36:40 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-4c0d4b61-237d-4625-b260-7b2c7ba9a582 tempest-VolumesSnapshotTestJSON-1399893733 None] Deleting offline snapshot d0200ae4-741d-4e0f-9af1-432b76f7dbf4 of volume 4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:36:40 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-4c0d4b61-237d-4625-b260-7b2c7ba9a582 tempest-VolumesSnapshotTestJSON-1399893733 None] snapshot_file for this snap is: volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e.d0200ae4-741d-4e0f-9af1-432b76f7dbf4 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:36:40 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4662661-42a1-405b-96cc-7dcafd8385ee]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:36:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4c0d4b61-237d-4625-b260-7b2c7ba9a582 tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e.d0200ae4-741d-4e0f-9af1-432b76f7dbf4 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:40 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-476b789f-5c76-4ab2-9dbe-138f3d5959af tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.801s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:40 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-476b789f-5c76-4ab2-9dbe-138f3d5959af tempest-VolumesSnapshotTestJSON-1399893733 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:36:40 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-476b789f-5c76-4ab2-9dbe-138f3d5959af tempest-VolumesSnapshotTestJSON-1399893733 None] Deleted volume successfully. Jun 04 06:36:40 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-476b789f-5c76-4ab2-9dbe-138f3d5959af tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-286ca578-9c0f-4ac0-9009-06f3079337b2-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:36:40 devstack sudo[98594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e.d0200ae4-741d-4e0f-9af1-432b76f7dbf4 Jun 04 06:36:40 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:40 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-59ad66fb-c8bb-4409-bf9f-78507a229c50 tempest-VolumesTransfersTest-426834884 None] Transfer volume completed successfully. Jun 04 06:36:41 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4c0d4b61-237d-4625-b260-7b2c7ba9a582 tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e.d0200ae4-741d-4e0f-9af1-432b76f7dbf4" returned: 0 in 0.996s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:41 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-4c0d4b61-237d-4625-b260-7b2c7ba9a582 tempest-VolumesSnapshotTestJSON-1399893733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:36:41 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e93ada-b2d8-49cc-bfc7-583ce9572829]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:36:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4c0d4b61-237d-4625-b260-7b2c7ba9a582 tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:41 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e Jun 04 06:36:41 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:41 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-71eb46b0-a658-4f7a-94cf-03603483add6 tempest-VolumesTransfersTest-1772249681 None] Acquiring lock "cinder-21d0bafc-1aa0-4f89-95de-be1195165a22-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:36:41 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-71eb46b0-a658-4f7a-94cf-03603483add6 tempest-VolumesTransfersTest-1772249681 None] Lock "cinder-21d0bafc-1aa0-4f89-95de-be1195165a22-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:36:41 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:INSERT=18,cinder:UPDATE=89,cinder:SELECT=89,cinder:DELETE=8 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:36:41 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-71eb46b0-a658-4f7a-94cf-03603483add6 tempest-VolumesTransfersTest-1772249681 None] Acquiring lock "cinder-quobyte-21d0bafc-1aa0-4f89-95de-be1195165a22" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:36:41 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-71eb46b0-a658-4f7a-94cf-03603483add6 tempest-VolumesTransfersTest-1772249681 None] Lock "cinder-quobyte-21d0bafc-1aa0-4f89-95de-be1195165a22" acquired by "delete_volume" :: waited 0.019s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:36:41 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6ce6f8-ca27-42a8-8f9f-67664a45ab34]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:36:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-71eb46b0-a658-4f7a-94cf-03603483add6 tempest-VolumesTransfersTest-1772249681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-21d0bafc-1aa0-4f89-95de-be1195165a22 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:41 devstack sudo[98601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-21d0bafc-1aa0-4f89-95de-be1195165a22 Jun 04 06:36:41 devstack sudo[98601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:42 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4c0d4b61-237d-4625-b260-7b2c7ba9a582 tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e" returned: 0 in 0.872s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4c0d4b61-237d-4625-b260-7b2c7ba9a582 tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e.d0200ae4-741d-4e0f-9af1-432b76f7dbf4 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:42 devstack sudo[98607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e.d0200ae4-741d-4e0f-9af1-432b76f7dbf4 Jun 04 06:36:42 devstack sudo[98607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:42 devstack sudo[98601]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-71eb46b0-a658-4f7a-94cf-03603483add6 tempest-VolumesTransfersTest-1772249681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-21d0bafc-1aa0-4f89-95de-be1195165a22" returned: 0 in 0.832s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-71eb46b0-a658-4f7a-94cf-03603483add6 tempest-VolumesTransfersTest-1772249681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-21d0bafc-1aa0-4f89-95de-be1195165a22 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:42 devstack sudo[98613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-21d0bafc-1aa0-4f89-95de-be1195165a22 Jun 04 06:36:42 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:43 devstack sudo[98607]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4c0d4b61-237d-4625-b260-7b2c7ba9a582 tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e.d0200ae4-741d-4e0f-9af1-432b76f7dbf4" returned: 0 in 1.005s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4c0d4b61-237d-4625-b260-7b2c7ba9a582 tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e.d0200ae4-741d-4e0f-9af1-432b76f7dbf4 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:43 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e.d0200ae4-741d-4e0f-9af1-432b76f7dbf4 Jun 04 06:36:43 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:43 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-71eb46b0-a658-4f7a-94cf-03603483add6 tempest-VolumesTransfersTest-1772249681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-21d0bafc-1aa0-4f89-95de-be1195165a22" returned: 0 in 0.792s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:43 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-71eb46b0-a658-4f7a-94cf-03603483add6 tempest-VolumesTransfersTest-1772249681 None] Lock "cinder-quobyte-21d0bafc-1aa0-4f89-95de-be1195165a22" released by "delete_volume" :: held 1.678s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:36:43 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-71eb46b0-a658-4f7a-94cf-03603483add6 tempest-VolumesTransfersTest-1772249681 None] Created reservations ['a5029bc5-7c58-4a9a-9807-37daf5e5cc94', '2380fa51-d290-404c-958c-967c33e59ee5', '2bac15d4-cee9-468d-a546-5300f52997ac', '52ed2cf7-5262-4c45-b91e-bb69626052b2'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:36:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-71eb46b0-a658-4f7a-94cf-03603483add6 tempest-VolumesTransfersTest-1772249681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:36:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-71eb46b0-a658-4f7a-94cf-03603483add6 tempest-VolumesTransfersTest-1772249681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:36:43 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-71eb46b0-a658-4f7a-94cf-03603483add6 tempest-VolumesTransfersTest-1772249681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:36:43 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-71eb46b0-a658-4f7a-94cf-03603483add6 tempest-VolumesTransfersTest-1772249681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:36:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-71eb46b0-a658-4f7a-94cf-03603483add6 tempest-VolumesTransfersTest-1772249681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:36:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-71eb46b0-a658-4f7a-94cf-03603483add6 tempest-VolumesTransfersTest-1772249681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:43 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:36:43 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:44 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4c0d4b61-237d-4625-b260-7b2c7ba9a582 tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e.d0200ae4-741d-4e0f-9af1-432b76f7dbf4" returned: 0 in 1.163s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:44 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4c0d4b61-237d-4625-b260-7b2c7ba9a582 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-quobyte-d0200ae4-741d-4e0f-9af1-432b76f7dbf4" released by "_delete_snapshot" :: held 4.234s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:36:44 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4c0d4b61-237d-4625-b260-7b2c7ba9a582 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-quobyte-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e" released by "delete_snapshot" :: held 4.286s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:36:44 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-71eb46b0-a658-4f7a-94cf-03603483add6 tempest-VolumesTransfersTest-1772249681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.944s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:44 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-71eb46b0-a658-4f7a-94cf-03603483add6 tempest-VolumesTransfersTest-1772249681 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:36:44 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-71eb46b0-a658-4f7a-94cf-03603483add6 tempest-VolumesTransfersTest-1772249681 None] Deleted volume successfully. Jun 04 06:36:44 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-4c0d4b61-237d-4625-b260-7b2c7ba9a582 tempest-VolumesSnapshotTestJSON-1399893733 None] Created reservations ['2060d942-2c62-4b30-8fe1-807b6fbd484e', '0cfe36d4-1f15-417f-810a-1b349e548119', '5455114f-77e5-4adf-bdef-639bc3e1b629', '15a6b8eb-d290-4420-822b-e78eeba51f73'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:36:44 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-71eb46b0-a658-4f7a-94cf-03603483add6 tempest-VolumesTransfersTest-1772249681 None] Lock "cinder-21d0bafc-1aa0-4f89-95de-be1195165a22-delete_volume" released by "delete_volume" :: held 2.990s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:36:44 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-4c0d4b61-237d-4625-b260-7b2c7ba9a582 tempest-VolumesSnapshotTestJSON-1399893733 None] Delete snapshot completed successfully. Jun 04 06:36:44 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4c0d4b61-237d-4625-b260-7b2c7ba9a582 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-d0200ae4-741d-4e0f-9af1-432b76f7dbf4-delete_snapshot" released by "delete_snapshot" :: held 4.600s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:36:44 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:36:44 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] Flow 'volume_create_manager' (c164fde7-8da6-4e31-9a0e-e87b8cc91da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:36:44 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4592963a-2fa1-47ab-90d5-5ad17ac34604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:44 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4592963a-2fa1-47ab-90d5-5ad17ac34604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2029787003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=227ab855-20eb-45cb-b607-534e67ec8077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33766f13991447ad832365d97bde3bf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:36:45Z,use_quota=True,user_id='176844a6c14442d1beaf1368b66e9915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:44 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195596e6-7c4f-4eaf-ad68-21c6f501f39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:44 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195596e6-7c4f-4eaf-ad68-21c6f501f39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:44 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55f1c26-4202-4607-a9ad-cacf745dbf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:44 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55f1c26-4202-4607-a9ad-cacf745dbf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '227ab855-20eb-45cb-b607-534e67ec8077', 'volume_name': 'volume-227ab855-20eb-45cb-b607-534e67ec8077', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:44 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d02805-b56c-4959-9bf3-d63638db9167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:44 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d02805-b56c-4959-9bf3-d63638db9167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:44 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c80ec5a2-969c-491a-9dee-49e57503434f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:44 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] Volume 227ab855-20eb-45cb-b607-534e67ec8077: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-227ab855-20eb-45cb-b607-534e67ec8077', 'volume_size': 1} Jun 04 06:36:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:36:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:36:44 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2029787003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=227ab855-20eb-45cb-b607-534e67ec8077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33766f13991447ad832365d97bde3bf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:36:45Z,use_quota=True,user_id='176844a6c14442d1beaf1368b66e9915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:36:44 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] Creating volume 227ab855-20eb-45cb-b607-534e67ec8077 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:36:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:36:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:36:44 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:36:44 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:36:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:36:44 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:36:44 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:36:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-227ab855-20eb-45cb-b607-534e67ec8077 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:45 devstack sudo[98625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-227ab855-20eb-45cb-b607-534e67ec8077 1073741824 Jun 04 06:36:45 devstack sudo[98625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:45 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a569bcf5-421f-4879-aa58-bce7a025fde2 tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "cinder-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:36:45 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a569bcf5-421f-4879-aa58-bce7a025fde2 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:36:45 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a569bcf5-421f-4879-aa58-bce7a025fde2 tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "cinder-quobyte-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:36:45 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a569bcf5-421f-4879-aa58-bce7a025fde2 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-quobyte-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e" acquired by "delete_volume" :: waited 0.019s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:36:45 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fd55f3-bf85-4ca0-9b48-ffb0782ac524]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:36:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a569bcf5-421f-4879-aa58-bce7a025fde2 tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:45 devstack sudo[98625]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-227ab855-20eb-45cb-b607-534e67ec8077 1073741824" returned: 0 in 0.863s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:45 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e Jun 04 06:36:45 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-227ab855-20eb-45cb-b607-534e67ec8077 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:45 devstack sudo[98633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-227ab855-20eb-45cb-b607-534e67ec8077 Jun 04 06:36:45 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:46 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a569bcf5-421f-4879-aa58-bce7a025fde2 tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e" returned: 0 in 0.788s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a569bcf5-421f-4879-aa58-bce7a025fde2 tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:46 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e Jun 04 06:36:46 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:46 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-227ab855-20eb-45cb-b607-534e67ec8077" returned: 0 in 0.685s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:46 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:36:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:36:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c80ec5a2-969c-491a-9dee-49e57503434f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-227ab855-20eb-45cb-b607-534e67ec8077', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57a505c-2748-4a01-9b9b-a52f0a728b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:46 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] Volume volume-227ab855-20eb-45cb-b607-534e67ec8077 (227ab855-20eb-45cb-b607-534e67ec8077): created successfully Jun 04 06:36:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57a505c-2748-4a01-9b9b-a52f0a728b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] Flow 'volume_create_manager' (c164fde7-8da6-4e31-9a0e-e87b8cc91da6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:36:46 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-779f71f1-cc10-47a6-97d8-23306f998987 tempest-VolumesTransfersTest-214173969 None] Created volume successfully. Jun 04 06:36:47 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a569bcf5-421f-4879-aa58-bce7a025fde2 tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e" returned: 0 in 0.639s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:47 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a569bcf5-421f-4879-aa58-bce7a025fde2 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-quobyte-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e" released by "delete_volume" :: held 1.488s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:36:47 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-a569bcf5-421f-4879-aa58-bce7a025fde2 tempest-VolumesSnapshotTestJSON-1399893733 None] Created reservations ['848a2fa7-0ce1-414f-be71-48f01daa54d9', '570c6e66-ae72-40ae-94e1-a4f0e5825d0e', 'bdfb1646-1d59-47b0-aba2-432816a2c7f7', 'c6000108-3a93-4613-8863-93850102c0a3'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:36:47 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-990d724e-a07f-4fc6-b894-5691747962f4 tempest-VolumesTransfersTest-1772249681 None] Acquiring lock "cinder-227ab855-20eb-45cb-b607-534e67ec8077-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:36:47 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-990d724e-a07f-4fc6-b894-5691747962f4 tempest-VolumesTransfersTest-1772249681 None] Lock "cinder-227ab855-20eb-45cb-b607-534e67ec8077-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:36:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a569bcf5-421f-4879-aa58-bce7a025fde2 tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:36:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a569bcf5-421f-4879-aa58-bce7a025fde2 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:36:47 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a569bcf5-421f-4879-aa58-bce7a025fde2 tempest-VolumesSnapshotTestJSON-1399893733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:36:47 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a569bcf5-421f-4879-aa58-bce7a025fde2 tempest-VolumesSnapshotTestJSON-1399893733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:36:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a569bcf5-421f-4879-aa58-bce7a025fde2 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:36:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a569bcf5-421f-4879-aa58-bce7a025fde2 tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:47 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-990d724e-a07f-4fc6-b894-5691747962f4 tempest-VolumesTransfersTest-1772249681 None] Acquiring lock "cinder-quobyte-227ab855-20eb-45cb-b607-534e67ec8077" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:36:47 devstack sudo[98645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:36:47 devstack sudo[98645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:47 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-990d724e-a07f-4fc6-b894-5691747962f4 tempest-VolumesTransfersTest-1772249681 None] Lock "cinder-quobyte-227ab855-20eb-45cb-b607-534e67ec8077" acquired by "delete_volume" :: waited 0.020s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:36:47 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee48ac7-1065-420e-937c-4ba7669e83f9]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:36:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-990d724e-a07f-4fc6-b894-5691747962f4 tempest-VolumesTransfersTest-1772249681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-227ab855-20eb-45cb-b607-534e67ec8077 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:47 devstack sudo[98647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-227ab855-20eb-45cb-b607-534e67ec8077 Jun 04 06:36:47 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:48 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-40c5c9e3-f21b-4abd-b6a1-d8bffac8f88d req-f2096402-20d3-4955-abca-de8a4a209c0d tempest-AttachVolumeShelveTestJSON-2104168720 None] Terminate volume connection completed successfully. Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-40c5c9e3-f21b-4abd-b6a1-d8bffac8f88d req-f2096402-20d3-4955-abca-de8a4a209c0d tempest-AttachVolumeShelveTestJSON-2104168720 None] Deleting attachment c5d1beeb-b6b6-4cb2-b67f-e3e05d4a9377. {{(pid=86069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 06:36:48 devstack sudo[98645]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a569bcf5-421f-4879-aa58-bce7a025fde2 tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.690s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-a569bcf5-421f-4879-aa58-bce7a025fde2 tempest-VolumesSnapshotTestJSON-1399893733 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:36:48 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-a569bcf5-421f-4879-aa58-bce7a025fde2 tempest-VolumesSnapshotTestJSON-1399893733 None] Deleted volume successfully. Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a569bcf5-421f-4879-aa58-bce7a025fde2 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-4eaf6685-e0a5-4c68-bfee-9d02f1dc4d8e-delete_volume" released by "delete_volume" :: held 2.414s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:36:48 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-990d724e-a07f-4fc6-b894-5691747962f4 tempest-VolumesTransfersTest-1772249681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-227ab855-20eb-45cb-b607-534e67ec8077" returned: 0 in 0.834s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-990d724e-a07f-4fc6-b894-5691747962f4 tempest-VolumesTransfersTest-1772249681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-227ab855-20eb-45cb-b607-534e67ec8077 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:48 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-227ab855-20eb-45cb-b607-534e67ec8077 Jun 04 06:36:48 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] Flow 'volume_create_manager' (718aa448-c599-4fca-a0d5-37cfac66d751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf791fe0-bafb-4943-b8e8-cb60d6dd1942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf791fe0-bafb-4943-b8e8-cb60d6dd1942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-698609375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08f5d425-76f0-4de3-91e2-f9e145589287,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3efeaf5c5c746c9b30246535ccbddd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:36:48Z,use_quota=True,user_id='c65b3028bde24d8da01c044e3ca0c87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43496f5d-c981-487c-89b7-f9ba03797a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43496f5d-c981-487c-89b7-f9ba03797a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0ce143c-9e66-4b3d-aa80-f0b5ce7830a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0ce143c-9e66-4b3d-aa80-f0b5ce7830a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08f5d425-76f0-4de3-91e2-f9e145589287', 'volume_name': 'volume-08f5d425-76f0-4de3-91e2-f9e145589287', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acd68960-862e-466b-ad8b-e3eccec8542e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acd68960-862e-466b-ad8b-e3eccec8542e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (661f0fd8-b5c8-49d6-b7d4-965e748880e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:48 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] Volume 08f5d425-76f0-4de3-91e2-f9e145589287: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08f5d425-76f0-4de3-91e2-f9e145589287', 'volume_size': 1} Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-698609375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08f5d425-76f0-4de3-91e2-f9e145589287,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3efeaf5c5c746c9b30246535ccbddd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:36:48Z,use_quota=True,user_id='c65b3028bde24d8da01c044e3ca0c87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] Creating volume 08f5d425-76f0-4de3-91e2-f9e145589287 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:36:48 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:48 devstack sudo[98658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287 1073741824 Jun 04 06:36:48 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:48 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-990d724e-a07f-4fc6-b894-5691747962f4 tempest-VolumesTransfersTest-1772249681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-227ab855-20eb-45cb-b607-534e67ec8077" returned: 0 in 0.612s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-990d724e-a07f-4fc6-b894-5691747962f4 tempest-VolumesTransfersTest-1772249681 None] Lock "cinder-quobyte-227ab855-20eb-45cb-b607-534e67ec8077" released by "delete_volume" :: held 1.490s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-990d724e-a07f-4fc6-b894-5691747962f4 tempest-VolumesTransfersTest-1772249681 None] Created reservations ['458a6ead-5aca-4e90-9290-a590ac7168d2', '598f39c3-575e-4756-9455-001a9468449f', 'f74af22c-3aaa-43c6-86be-74450ab48d1f', 'ae1dbe37-0b72-4836-9d86-1c348123f611'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-990d724e-a07f-4fc6-b894-5691747962f4 tempest-VolumesTransfersTest-1772249681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-990d724e-a07f-4fc6-b894-5691747962f4 tempest-VolumesTransfersTest-1772249681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-990d724e-a07f-4fc6-b894-5691747962f4 tempest-VolumesTransfersTest-1772249681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-990d724e-a07f-4fc6-b894-5691747962f4 tempest-VolumesTransfersTest-1772249681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-990d724e-a07f-4fc6-b894-5691747962f4 tempest-VolumesTransfersTest-1772249681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:36:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-990d724e-a07f-4fc6-b894-5691747962f4 tempest-VolumesTransfersTest-1772249681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:49 devstack sudo[98663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:36:49 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:49 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287 1073741824" returned: 0 in 0.804s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:49 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287 Jun 04 06:36:49 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:49 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-990d724e-a07f-4fc6-b894-5691747962f4 tempest-VolumesTransfersTest-1772249681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.662s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:49 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-990d724e-a07f-4fc6-b894-5691747962f4 tempest-VolumesTransfersTest-1772249681 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:36:49 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-990d724e-a07f-4fc6-b894-5691747962f4 tempest-VolumesTransfersTest-1772249681 None] Deleted volume successfully. Jun 04 06:36:49 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-990d724e-a07f-4fc6-b894-5691747962f4 tempest-VolumesTransfersTest-1772249681 None] Lock "cinder-227ab855-20eb-45cb-b607-534e67ec8077-delete_volume" released by "delete_volume" :: held 2.419s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:36:49 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287" returned: 0 in 0.652s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:49 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:36:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:36:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (661f0fd8-b5c8-49d6-b7d4-965e748880e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08f5d425-76f0-4de3-91e2-f9e145589287', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8609c2a-c117-45cb-9953-8d9c56ad5e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:50 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] Volume volume-08f5d425-76f0-4de3-91e2-f9e145589287 (08f5d425-76f0-4de3-91e2-f9e145589287): created successfully Jun 04 06:36:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8609c2a-c117-45cb-9953-8d9c56ad5e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] Flow 'volume_create_manager' (718aa448-c599-4fca-a0d5-37cfac66d751) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:36:50 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-27019281-4772-45fc-828d-9102faf9db70 tempest-VolumesSnapshotTestJSON-1399893733 None] Created volume successfully. Jun 04 06:36:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-09712a6b-92dd-405c-8a4d-889944f0bca3 tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:36:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-09712a6b-92dd-405c-8a4d-889944f0bca3 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:36:50 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-09712a6b-92dd-405c-8a4d-889944f0bca3 tempest-VolumesSnapshotTestJSON-1399893733 None] Creating offline snapshot 75e87948-10bf-483b-ad85-e6d40eb4109c of volume 08f5d425-76f0-4de3-91e2-f9e145589287 {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:36:50 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c13b53-4fd9-4944-80b9-c2fa8664852a]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:36:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-09712a6b-92dd-405c-8a4d-889944f0bca3 tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:50 devstack sudo[98670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287 Jun 04 06:36:50 devstack sudo[98670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:51 devstack sudo[98670]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-09712a6b-92dd-405c-8a4d-889944f0bca3 tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287" returned: 0 in 1.190s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-09712a6b-92dd-405c-8a4d-889944f0bca3 tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287.75e87948-10bf-483b-ad85-e6d40eb4109c 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:51 devstack sudo[98750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287.75e87948-10bf-483b-ad85-e6d40eb4109c 1G Jun 04 06:36:51 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:53 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-09712a6b-92dd-405c-8a4d-889944f0bca3 tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287.75e87948-10bf-483b-ad85-e6d40eb4109c 1G" returned: 0 in 1.089s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-09712a6b-92dd-405c-8a4d-889944f0bca3 tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08f5d425-76f0-4de3-91e2-f9e145589287 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287.75e87948-10bf-483b-ad85-e6d40eb4109c {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:53 devstack sudo[98768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08f5d425-76f0-4de3-91e2-f9e145589287 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287.75e87948-10bf-483b-ad85-e6d40eb4109c Jun 04 06:36:53 devstack sudo[98768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:53 devstack sudo[98768]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-09712a6b-92dd-405c-8a4d-889944f0bca3 tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08f5d425-76f0-4de3-91e2-f9e145589287 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287.75e87948-10bf-483b-ad85-e6d40eb4109c" returned: 0 in 0.820s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:53 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-09712a6b-92dd-405c-8a4d-889944f0bca3 tempest-VolumesSnapshotTestJSON-1399893733 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287.75e87948-10bf-483b-ad85-e6d40eb4109c is being set with open permissions: ugo+rw Jun 04 06:36:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-09712a6b-92dd-405c-8a4d-889944f0bca3 tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287.75e87948-10bf-483b-ad85-e6d40eb4109c {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:53 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287.75e87948-10bf-483b-ad85-e6d40eb4109c Jun 04 06:36:53 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:54 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-09712a6b-92dd-405c-8a4d-889944f0bca3 tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287.75e87948-10bf-483b-ad85-e6d40eb4109c" returned: 0 in 0.741s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-09712a6b-92dd-405c-8a4d-889944f0bca3 tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:54 devstack sudo[98782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287.info Jun 04 06:36:54 devstack sudo[98782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:55 devstack sudo[98782]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-09712a6b-92dd-405c-8a4d-889944f0bca3 tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287.info" returned: 0 in 0.693s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:55 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-09712a6b-92dd-405c-8a4d-889944f0bca3 tempest-VolumesSnapshotTestJSON-1399893733 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287.info is being set with open permissions: ugo+rw Jun 04 06:36:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-09712a6b-92dd-405c-8a4d-889944f0bca3 tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:55 devstack sudo[98785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287.info Jun 04 06:36:55 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:55 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-09712a6b-92dd-405c-8a4d-889944f0bca3 tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287.info" returned: 0 in 0.644s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-09712a6b-92dd-405c-8a4d-889944f0bca3 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.313s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:36:56 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-09712a6b-92dd-405c-8a4d-889944f0bca3 tempest-VolumesSnapshotTestJSON-1399893733 None] Create snapshot completed successfully Jun 04 06:36:56 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:36:56 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Flow 'volume_create_manager' (60e46b70-6b94-42e5-9cd0-a5ea679d3906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:36:56 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8131a13b-dccf-4e08-b261-378aaea81421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:56 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8131a13b-dccf-4e08-b261-378aaea81421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-610381924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c805a26e-5b77-4eb7-afbf-def10f8db689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1779416a67846c5a1e175bf2381e1f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:36:57Z,use_quota=True,user_id='290e4899480446708d46261103f6aa31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:56 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22215413-cbde-4d71-9c33-74aad83e92e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:56 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22215413-cbde-4d71-9c33-74aad83e92e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:56 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a56f52f8-5189-42b5-a728-802d6fc82b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:56 devstack cinder-volume[86069]: DEBUG cinder.image.glance [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Creating Keystone auth plugin from conf {{(pid=86069) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a56f52f8-5189-42b5-a728-802d6fc82b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c805a26e-5b77-4eb7-afbf-def10f8db689', 'volume_name': 'volume-c805a26e-5b77-4eb7-afbf-def10f8db689', 'volume_size': 1, 'image_id': '356a113c-ac9f-4c32-896c-2ab17fc4b371', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/356a113c-ac9f-4c32-896c-2ab17fc4b371', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73b4c085134a4115abd513b2dd9d6c91', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '356a113c-ac9f-4c32-896c-2ab17fc4b371', 'created_at': datetime.datetime(2026, 6, 4, 4, 19, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 4, 19, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/356a113c-ac9f-4c32-896c-2ab17fc4b371/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed62f894-a95b-4fd0-adbf-444d2af99104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed62f894-a95b-4fd0-adbf-444d2af99104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd353fd-0779-4358-84a8-b8f4312aedc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:57 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Volume c805a26e-5b77-4eb7-afbf-def10f8db689: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c805a26e-5b77-4eb7-afbf-def10f8db689', 'volume_size': 1, 'image_id': '356a113c-ac9f-4c32-896c-2ab17fc4b371', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/356a113c-ac9f-4c32-896c-2ab17fc4b371', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73b4c085134a4115abd513b2dd9d6c91', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '356a113c-ac9f-4c32-896c-2ab17fc4b371', 'created_at': datetime.datetime(2026, 6, 4, 4, 19, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 4, 19, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/356a113c-ac9f-4c32-896c-2ab17fc4b371/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Trying to clone c805a26e-5b77-4eb7-afbf-def10f8db689 from image 356a113c-ac9f-4c32-896c-2ab17fc4b371 at location (None, [{'url': 'file:///opt/stack/data/glance/images/356a113c-ac9f-4c32-896c-2ab17fc4b371', 'metadata': {}}]). {{(pid=86069) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Flow 'volume_create_manager' (bbcc96cb-b8e6-4855-bcd8-bb61fcb01820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e38ca5-2bbf-4276-89ae-7028a60cf60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e38ca5-2bbf-4276-89ae-7028a60cf60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-18328623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eba8f1a-b058-4fd2-8e0e-3b3a373953ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3efeaf5c5c746c9b30246535ccbddd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=75e87948-10bf-483b-ad85-e6d40eb4109c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:36:58Z,use_quota=True,user_id='c65b3028bde24d8da01c044e3ca0c87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7397cc04-49b8-4c8b-bbd2-e8bd5e6daa38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7397cc04-49b8-4c8b-bbd2-e8bd5e6daa38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd698455-b946-437f-90c7-09d00064116b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd698455-b946-437f-90c7-09d00064116b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9eba8f1a-b058-4fd2-8e0e-3b3a373953ac', 'volume_name': 'volume-9eba8f1a-b058-4fd2-8e0e-3b3a373953ac', 'volume_size': 1, 'snapshot_id': '75e87948-10bf-483b-ad85-e6d40eb4109c'}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43030896-7013-44c4-9eff-a7173d0e35c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43030896-7013-44c4-9eff-a7173d0e35c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (782f323a-6e8d-4a84-a483-64b8456381d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:36:57 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Volume 9eba8f1a-b058-4fd2-8e0e-3b3a373953ac: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9eba8f1a-b058-4fd2-8e0e-3b3a373953ac', 'volume_size': 1, 'snapshot_id': '75e87948-10bf-483b-ad85-e6d40eb4109c'} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "cinder-quobyte-75e87948-10bf-483b-ad85-e6d40eb4109c-9eba8f1a-b058-4fd2-8e0e-3b3a373953ac" by "_create_volume_from_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371__r_b4vk5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86069) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 04 06:36:57 devstack cinder-volume[86069]: INFO cinder.image.image_utils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Image download 20.69 MB at 20.69 MB/s Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-quobyte-75e87948-10bf-483b-ad85-e6d40eb4109c-9eba8f1a-b058-4fd2-8e0e-3b3a373953ac" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Creating volume 9eba8f1a-b058-4fd2-8e0e-3b3a373953ac from snapshot 75e87948-10bf-483b-ad85-e6d40eb4109c {{(pid=86069) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "cinder-quobyte-9eba8f1a-b058-4fd2-8e0e-3b3a373953ac" by "_copy_volume_from_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-quobyte-9eba8f1a-b058-4fd2-8e0e-3b3a373953ac" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] snapshot: 75e87948-10bf-483b-ad85-e6d40eb4109c, volume: 9eba8f1a-b058-4fd2-8e0e-3b3a373953ac, {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a821928-6e2b-4bcb-b4ff-418223e070a5]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287.75e87948-10bf-483b-ad85-e6d40eb4109c {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fdc414-f02b-4bbd-9756-478de25b8ac8]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:36:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371__r_b4vk5devstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:57 devstack sudo[98790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287.75e87948-10bf-483b-ad85-e6d40eb4109c Jun 04 06:36:57 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:57 devstack sudo[98791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371__r_b4vk5devstack@QuobyteHD Jun 04 06:36:57 devstack sudo[98791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:58 devstack sudo[98791]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371__r_b4vk5devstack@QuobyteHD" returned: 0 in 0.709s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:58 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Temporary image 356a113c-ac9f-4c32-896c-2ab17fc4b371 is fetched for user 290e4899480446708d46261103f6aa31. {{(pid=86069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 04 06:36:58 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287.75e87948-10bf-483b-ad85-e6d40eb4109c" returned: 0 in 0.779s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:58 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08f5d425-76f0-4de3-91e2-f9e145589287(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:36:58 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287 {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 06:36:58 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Creating direct copy from snapshot {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 06:36:58 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f225019a-e5fc-42f9-981a-f465d236d0fb]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:36:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:58 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0895cdb-b794-49a7-9f26-74a3824b36ea]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:36:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371__r_b4vk5devstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:58 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287 Jun 04 06:36:58 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:58 devstack sudo[98802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371__r_b4vk5devstack@QuobyteHD Jun 04 06:36:58 devstack sudo[98802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:59 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287" returned: 0 in 0.763s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:59 devstack cinder-volume[86069]: DEBUG cinder.utils [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Path /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9eba8f1a-b058-4fd2-8e0e-3b3a373953ac not found in is_blk_device check {{(pid=86069) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 04 06:36:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9eba8f1a-b058-4fd2-8e0e-3b3a373953ac {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:36:59 devstack sudo[98811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9eba8f1a-b058-4fd2-8e0e-3b3a373953ac Jun 04 06:36:59 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:36:59 devstack sudo[98802]: pam_unix(sudo:session): session closed for user root Jun 04 06:36:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371__r_b4vk5devstack@QuobyteHD" returned: 0 in 0.839s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:36:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:37:04 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9eba8f1a-b058-4fd2-8e0e-3b3a373953ac" returned: 0 in 5.447s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:04 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[c965ea93-7b2c-4b0d-9575-c494b6cb941f]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:37:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:04 devstack sudo[98825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287 Jun 04 06:37:04 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:05 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287" returned: 0 in 0.969s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:05 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Image conversion details: src /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287, size 1024.00 MB, duration 5.45 sec, destination /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9eba8f1a-b058-4fd2-8e0e-3b3a373953ac {{(pid=86069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 06:37:05 devstack cinder-volume[86069]: INFO cinder.image.image_utils [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Converted 1024.00 MB image at 187.95 MB/s Jun 04 06:37:05 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9eba8f1a-b058-4fd2-8e0e-3b3a373953ac is being set with open permissions: ugo+rw Jun 04 06:37:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9eba8f1a-b058-4fd2-8e0e-3b3a373953ac {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:05 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9eba8f1a-b058-4fd2-8e0e-3b3a373953ac Jun 04 06:37:05 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:06 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9eba8f1a-b058-4fd2-8e0e-3b3a373953ac" returned: 0 in 0.669s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:06 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-quobyte-9eba8f1a-b058-4fd2-8e0e-3b3a373953ac" released by "_copy_volume_from_snapshot" :: held 8.730s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:37:06 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-quobyte-75e87948-10bf-483b-ad85-e6d40eb4109c-9eba8f1a-b058-4fd2-8e0e-3b3a373953ac" released by "_create_volume_from_snapshot" :: held 8.760s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:37:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.794s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:37:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.027s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:37:06 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-610381924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c805a26e-5b77-4eb7-afbf-def10f8db689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1779416a67846c5a1e175bf2381e1f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:36:57Z,use_quota=True,user_id='290e4899480446708d46261103f6aa31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:37:06 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Creating volume c805a26e-5b77-4eb7-afbf-def10f8db689 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:37:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:37:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:37:06 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:37:06 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:37:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:37:06 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:37:06 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:37:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:06 devstack sudo[98833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689 1073741824 Jun 04 06:37:06 devstack sudo[98833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:06 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (782f323a-6e8d-4a84-a483-64b8456381d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eba8f1a-b058-4fd2-8e0e-3b3a373953ac', 'volume_size': 1, 'snapshot_id': '75e87948-10bf-483b-ad85-e6d40eb4109c'}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:06 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b28faf-94ee-4e74-b953-2d812a06f927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:06 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Volume volume-9eba8f1a-b058-4fd2-8e0e-3b3a373953ac (9eba8f1a-b058-4fd2-8e0e-3b3a373953ac): created successfully Jun 04 06:37:06 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b28faf-94ee-4e74-b953-2d812a06f927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:06 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Flow 'volume_create_manager' (bbcc96cb-b8e6-4855-bcd8-bb61fcb01820) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:37:06 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-d7aaf5ae-86d0-4e6f-bcaf-29f4c5ac7cbb tempest-VolumesSnapshotTestJSON-1399893733 None] Created volume successfully. Jun 04 06:37:07 devstack sudo[98833]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689 1073741824" returned: 0 in 0.895s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:07 devstack sudo[98840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689 Jun 04 06:37:07 devstack sudo[98840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:07 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d863f3a2-32e3-427b-8dc6-cc1df24fb49c tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "cinder-9eba8f1a-b058-4fd2-8e0e-3b3a373953ac-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:37:07 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d863f3a2-32e3-427b-8dc6-cc1df24fb49c tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-9eba8f1a-b058-4fd2-8e0e-3b3a373953ac-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:37:07 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d863f3a2-32e3-427b-8dc6-cc1df24fb49c tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "cinder-quobyte-9eba8f1a-b058-4fd2-8e0e-3b3a373953ac" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:37:07 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d863f3a2-32e3-427b-8dc6-cc1df24fb49c tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-quobyte-9eba8f1a-b058-4fd2-8e0e-3b3a373953ac" acquired by "delete_volume" :: waited 0.019s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:37:07 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[5060605d-a3cf-48e7-b285-4e5290b5c959]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:37:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d863f3a2-32e3-427b-8dc6-cc1df24fb49c tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9eba8f1a-b058-4fd2-8e0e-3b3a373953ac {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:07 devstack sudo[98842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9eba8f1a-b058-4fd2-8e0e-3b3a373953ac Jun 04 06:37:07 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:08 devstack sudo[98840]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689" returned: 0 in 0.665s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:08 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:37:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:37:08 devstack cinder-volume[86069]: DEBUG cinder.volume.volume_utils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Attempting download of 356a113c-ac9f-4c32-896c-2ab17fc4b371 ((None, [{'url': 'file:///opt/stack/data/glance/images/356a113c-ac9f-4c32-896c-2ab17fc4b371', 'metadata': {}}])) to volume c805a26e-5b77-4eb7-afbf-def10f8db689. {{(pid=86069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 04 06:37:08 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ddfe45-dc69-4959-b5aa-95a3b4edd8a0]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:37:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_356a113c-ac9f-4c32-896c-2ab17fc4b371_g3lw96p4 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:08 devstack sudo[98845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_356a113c-ac9f-4c32-896c-2ab17fc4b371_g3lw96p4 Jun 04 06:37:08 devstack sudo[98845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:08 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d863f3a2-32e3-427b-8dc6-cc1df24fb49c tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9eba8f1a-b058-4fd2-8e0e-3b3a373953ac" returned: 0 in 0.760s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d863f3a2-32e3-427b-8dc6-cc1df24fb49c tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9eba8f1a-b058-4fd2-8e0e-3b3a373953ac {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:08 devstack sudo[98850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9eba8f1a-b058-4fd2-8e0e-3b3a373953ac Jun 04 06:37:08 devstack sudo[98850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:09 devstack sudo[98845]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_356a113c-ac9f-4c32-896c-2ab17fc4b371_g3lw96p4" returned: 0 in 0.802s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_356a113c-ac9f-4c32-896c-2ab17fc4b371_g3lw96p4 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:09 devstack sudo[98850]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d863f3a2-32e3-427b-8dc6-cc1df24fb49c tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9eba8f1a-b058-4fd2-8e0e-3b3a373953ac" returned: 0 in 0.618s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:09 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d863f3a2-32e3-427b-8dc6-cc1df24fb49c tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-quobyte-9eba8f1a-b058-4fd2-8e0e-3b3a373953ac" released by "delete_volume" :: held 1.428s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:37:09 devstack sudo[98855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_356a113c-ac9f-4c32-896c-2ab17fc4b371_g3lw96p4 Jun 04 06:37:09 devstack sudo[98855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:09 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-d863f3a2-32e3-427b-8dc6-cc1df24fb49c tempest-VolumesSnapshotTestJSON-1399893733 None] Created reservations ['d49ab6de-5740-469a-93c4-7a06d2ee48f2', 'e1a4fca6-ccfb-4ea5-8ea1-cb0036e434c6', 'f9f0fc1c-80e3-466d-9179-d7932148662a', 'ac49ff41-38fe-47be-82c7-5a3ed751536f'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:37:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d863f3a2-32e3-427b-8dc6-cc1df24fb49c tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:37:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d863f3a2-32e3-427b-8dc6-cc1df24fb49c tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:37:09 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d863f3a2-32e3-427b-8dc6-cc1df24fb49c tempest-VolumesSnapshotTestJSON-1399893733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:37:09 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d863f3a2-32e3-427b-8dc6-cc1df24fb49c tempest-VolumesSnapshotTestJSON-1399893733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:37:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d863f3a2-32e3-427b-8dc6-cc1df24fb49c tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:37:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d863f3a2-32e3-427b-8dc6-cc1df24fb49c tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:09 devstack sudo[98857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:37:09 devstack sudo[98857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:09 devstack sudo[98855]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_356a113c-ac9f-4c32-896c-2ab17fc4b371_g3lw96p4" returned: 1 in 0.755s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_356a113c-ac9f-4c32-896c-2ab17fc4b371_g3lw96p4' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:37:09 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ead3605-0cdd-43d2-ae2e-467bfd04e194]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:37:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371__r_b4vk5devstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:09 devstack sudo[98861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371__r_b4vk5devstack@QuobyteHD Jun 04 06:37:09 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:09 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-2647816a-921a-4079-b458-20feb50ed88c tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "cinder-75e87948-10bf-483b-ad85-e6d40eb4109c-delete_snapshot" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:37:10 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-2647816a-921a-4079-b458-20feb50ed88c tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-75e87948-10bf-483b-ad85-e6d40eb4109c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:37:10 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-2647816a-921a-4079-b458-20feb50ed88c tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "cinder-quobyte-08f5d425-76f0-4de3-91e2-f9e145589287" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:37:10 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-2647816a-921a-4079-b458-20feb50ed88c tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-quobyte-08f5d425-76f0-4de3-91e2-f9e145589287" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:37:10 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-2647816a-921a-4079-b458-20feb50ed88c tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "cinder-quobyte-75e87948-10bf-483b-ad85-e6d40eb4109c" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:37:10 devstack sudo[98857]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:10 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-2647816a-921a-4079-b458-20feb50ed88c tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-quobyte-75e87948-10bf-483b-ad85-e6d40eb4109c" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:37:10 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-2647816a-921a-4079-b458-20feb50ed88c tempest-VolumesSnapshotTestJSON-1399893733 None] Deleting offline snapshot 75e87948-10bf-483b-ad85-e6d40eb4109c of volume 08f5d425-76f0-4de3-91e2-f9e145589287 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:37:10 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-2647816a-921a-4079-b458-20feb50ed88c tempest-VolumesSnapshotTestJSON-1399893733 None] snapshot_file for this snap is: volume-08f5d425-76f0-4de3-91e2-f9e145589287.75e87948-10bf-483b-ad85-e6d40eb4109c {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:37:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d863f3a2-32e3-427b-8dc6-cc1df24fb49c tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.849s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:10 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-d863f3a2-32e3-427b-8dc6-cc1df24fb49c tempest-VolumesSnapshotTestJSON-1399893733 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:37:10 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-d863f3a2-32e3-427b-8dc6-cc1df24fb49c tempest-VolumesSnapshotTestJSON-1399893733 None] Deleted volume successfully. Jun 04 06:37:10 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6490b73-ff7a-4eef-b372-16a86d758f08]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:37:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-2647816a-921a-4079-b458-20feb50ed88c tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287.75e87948-10bf-483b-ad85-e6d40eb4109c {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:10 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d863f3a2-32e3-427b-8dc6-cc1df24fb49c tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-9eba8f1a-b058-4fd2-8e0e-3b3a373953ac-delete_volume" released by "delete_volume" :: held 2.504s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:37:10 devstack sudo[98864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287.75e87948-10bf-483b-ad85-e6d40eb4109c Jun 04 06:37:10 devstack sudo[98864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:10 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371__r_b4vk5devstack@QuobyteHD" returned: 0 in 0.872s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:10 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] 356a113c-ac9f-4c32-896c-2ab17fc4b371 was qcow2, converting to raw {{(pid=86069) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 04 06:37:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371__r_b4vk5devstack@QuobyteHD /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:10 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371__r_b4vk5devstack@QuobyteHD /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689 Jun 04 06:37:10 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:11 devstack sudo[98864]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-2647816a-921a-4079-b458-20feb50ed88c tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287.75e87948-10bf-483b-ad85-e6d40eb4109c" returned: 0 in 0.979s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-2647816a-921a-4079-b458-20feb50ed88c tempest-VolumesSnapshotTestJSON-1399893733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08f5d425-76f0-4de3-91e2-f9e145589287(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:37:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:37:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:37:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:37:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:37:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:37:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:37:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:11 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[322558f4-86fd-46db-ba4c-27cc4a4b2219]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:37:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-2647816a-921a-4079-b458-20feb50ed88c tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:11 devstack sudo[98875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:37:11 devstack sudo[98875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:11 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287 Jun 04 06:37:11 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:12 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:12 devstack sudo[98875]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.216s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:12 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:37:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-2647816a-921a-4079-b458-20feb50ed88c tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287" returned: 0 in 1.203s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-2647816a-921a-4079-b458-20feb50ed88c tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287.75e87948-10bf-483b-ad85-e6d40eb4109c {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:12 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager._thread_info {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:37:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread count: 28 {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 06:37:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread info: [<_MainThread(MainThread, started 131797370544256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 06:37:12 devstack sudo[98916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287.75e87948-10bf-483b-ad85-e6d40eb4109c Jun 04 06:37:12 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:13 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-2647816a-921a-4079-b458-20feb50ed88c tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287.75e87948-10bf-483b-ad85-e6d40eb4109c" returned: 0 in 0.766s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-2647816a-921a-4079-b458-20feb50ed88c tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287.75e87948-10bf-483b-ad85-e6d40eb4109c {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:13 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287.75e87948-10bf-483b-ad85-e6d40eb4109c Jun 04 06:37:13 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:13 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371__r_b4vk5devstack@QuobyteHD /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689" returned: 0 in 2.719s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:13 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371__r_b4vk5devstack@QuobyteHD, size 112.00 MB, duration 2.72 sec, destination /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689 {{(pid=86069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 06:37:13 devstack cinder-volume[86069]: INFO cinder.image.image_utils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Converted 112.00 MB image at 41.17 MB/s Jun 04 06:37:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:13 devstack sudo[98923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689 1G Jun 04 06:37:13 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:13 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-2647816a-921a-4079-b458-20feb50ed88c tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287.75e87948-10bf-483b-ad85-e6d40eb4109c" returned: 0 in 0.609s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:13 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-2647816a-921a-4079-b458-20feb50ed88c tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-quobyte-75e87948-10bf-483b-ad85-e6d40eb4109c" released by "_delete_snapshot" :: held 3.727s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:37:13 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-2647816a-921a-4079-b458-20feb50ed88c tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-quobyte-08f5d425-76f0-4de3-91e2-f9e145589287" released by "delete_snapshot" :: held 3.762s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:37:13 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-2647816a-921a-4079-b458-20feb50ed88c tempest-VolumesSnapshotTestJSON-1399893733 None] Created reservations ['2cc0c8de-e402-4b5c-af26-7555f7759679', '8e0729e2-e7da-45f3-b51e-6d23dc3727ce', '5ed8edec-0cf0-4394-bac5-efb2f725f6ee', '01d0daee-11e1-4d6c-9304-04f4d1c506a5'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:37:13 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-2647816a-921a-4079-b458-20feb50ed88c tempest-VolumesSnapshotTestJSON-1399893733 None] Delete snapshot completed successfully. Jun 04 06:37:13 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-2647816a-921a-4079-b458-20feb50ed88c tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-75e87948-10bf-483b-ad85-e6d40eb4109c-delete_snapshot" released by "delete_snapshot" :: held 3.908s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:37:14 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689 1G" returned: 0 in 0.793s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:14 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a06e146-5da4-478c-b5a4-1bf322592189]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:37:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:14 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-dc0fa0c9-8918-4aa4-8af5-9171e5086c57 tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "cinder-08f5d425-76f0-4de3-91e2-f9e145589287-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:37:14 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-dc0fa0c9-8918-4aa4-8af5-9171e5086c57 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-08f5d425-76f0-4de3-91e2-f9e145589287-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:37:14 devstack sudo[98929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689 Jun 04 06:37:14 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:14 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-dc0fa0c9-8918-4aa4-8af5-9171e5086c57 tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "cinder-quobyte-08f5d425-76f0-4de3-91e2-f9e145589287" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:37:14 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-dc0fa0c9-8918-4aa4-8af5-9171e5086c57 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-quobyte-08f5d425-76f0-4de3-91e2-f9e145589287" acquired by "delete_volume" :: waited 0.021s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:37:14 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53b602f-9ecc-4a09-91fd-0f3aca20b1e3]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:37:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dc0fa0c9-8918-4aa4-8af5-9171e5086c57 tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:14 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287 Jun 04 06:37:14 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:15 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689" returned: 0 in 0.934s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:15 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689 Jun 04 06:37:15 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:15 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dc0fa0c9-8918-4aa4-8af5-9171e5086c57 tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287" returned: 0 in 0.832s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dc0fa0c9-8918-4aa4-8af5-9171e5086c57 tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:15 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287 Jun 04 06:37:15 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:15 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689" returned: 1 in 0.804s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:37:15 devstack cinder-volume[86069]: DEBUG cinder.volume.volume_utils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Downloaded image 356a113c-ac9f-4c32-896c-2ab17fc4b371 ((None, [{'url': 'file:///opt/stack/data/glance/images/356a113c-ac9f-4c32-896c-2ab17fc4b371', 'metadata': {}}])) to volume c805a26e-5b77-4eb7-afbf-def10f8db689 successfully. {{(pid=86069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 04 06:37:15 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Temporary image 356a113c-ac9f-4c32-896c-2ab17fc4b371 for user 290e4899480446708d46261103f6aa31 is deleted. {{(pid=86069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 04 06:37:15 devstack cinder-volume[86069]: DEBUG cinder.volume.volume_utils [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Marking volume c805a26e-5b77-4eb7-afbf-def10f8db689 as bootable. {{(pid=86069) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 04 06:37:16 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Copying metadata from image 356a113c-ac9f-4c32-896c-2ab17fc4b371 to c805a26e-5b77-4eb7-afbf-def10f8db689. {{(pid=86069) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 04 06:37:16 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Creating volume glance metadata for volume c805a26e-5b77-4eb7-afbf-def10f8db689 backed by image 356a113c-ac9f-4c32-896c-2ab17fc4b371 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '356a113c-ac9f-4c32-896c-2ab17fc4b371', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86069) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 04 06:37:16 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dc0fa0c9-8918-4aa4-8af5-9171e5086c57 tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-08f5d425-76f0-4de3-91e2-f9e145589287" returned: 0 in 0.680s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:16 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-dc0fa0c9-8918-4aa4-8af5-9171e5086c57 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-quobyte-08f5d425-76f0-4de3-91e2-f9e145589287" released by "delete_volume" :: held 1.610s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:37:16 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd353fd-0779-4358-84a8-b8f4312aedc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c805a26e-5b77-4eb7-afbf-def10f8db689', 'volume_size': 1, 'image_id': '356a113c-ac9f-4c32-896c-2ab17fc4b371', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/356a113c-ac9f-4c32-896c-2ab17fc4b371', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73b4c085134a4115abd513b2dd9d6c91', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '356a113c-ac9f-4c32-896c-2ab17fc4b371', 'created_at': datetime.datetime(2026, 6, 4, 4, 19, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 4, 19, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/356a113c-ac9f-4c32-896c-2ab17fc4b371/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:16 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c29053b-bd92-48d8-8605-e9a4ebcb2fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:16 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-dc0fa0c9-8918-4aa4-8af5-9171e5086c57 tempest-VolumesSnapshotTestJSON-1399893733 None] Created reservations ['0d0095d3-fa2c-4b45-8d55-ccbb65bbc41c', '4971083f-278b-4b3b-9c71-4d3c2d915cd6', '71bbb59d-32fa-4cf6-85cc-23aff9bb2e2a', 'a4283985-3859-44e7-bfad-d0b794a72d86'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:37:16 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Volume volume-c805a26e-5b77-4eb7-afbf-def10f8db689 (c805a26e-5b77-4eb7-afbf-def10f8db689): created successfully Jun 04 06:37:16 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c29053b-bd92-48d8-8605-e9a4ebcb2fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:16 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Flow 'volume_create_manager' (60e46b70-6b94-42e5-9cd0-a5ea679d3906) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:37:16 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-bf7aff72-15d1-46df-ac54-36946701f917 tempest-VolumesExtendTest-325376471 None] Created volume successfully. Jun 04 06:37:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-dc0fa0c9-8918-4aa4-8af5-9171e5086c57 tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:37:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-dc0fa0c9-8918-4aa4-8af5-9171e5086c57 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:37:16 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-dc0fa0c9-8918-4aa4-8af5-9171e5086c57 tempest-VolumesSnapshotTestJSON-1399893733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:37:16 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-dc0fa0c9-8918-4aa4-8af5-9171e5086c57 tempest-VolumesSnapshotTestJSON-1399893733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:37:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-dc0fa0c9-8918-4aa4-8af5-9171e5086c57 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:37:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dc0fa0c9-8918-4aa4-8af5-9171e5086c57 tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:16 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:37:16 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:16 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9da66133-8b7c-45cd-8c48-6bb5e890c1d4 tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "cinder-56a08760-5686-43ee-aa09-446cd6b7a6f1-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:37:16 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9da66133-8b7c-45cd-8c48-6bb5e890c1d4 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-56a08760-5686-43ee-aa09-446cd6b7a6f1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:37:16 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9da66133-8b7c-45cd-8c48-6bb5e890c1d4 tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "cinder-quobyte-56a08760-5686-43ee-aa09-446cd6b7a6f1" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:37:16 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9da66133-8b7c-45cd-8c48-6bb5e890c1d4 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-quobyte-56a08760-5686-43ee-aa09-446cd6b7a6f1" acquired by "delete_volume" :: waited 0.021s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:37:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-3e3d772f-9a82-4108-b53d-454356c1c35d tempest-VolumesExtendTest-325376471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:37:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-3e3d772f-9a82-4108-b53d-454356c1c35d tempest-VolumesExtendTest-325376471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:37:16 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc68072f-54cb-4322-9ecf-cfed128c7bf5]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:37:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9da66133-8b7c-45cd-8c48-6bb5e890c1d4 tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:16 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[0febdcfb-94cd-403f-922a-3ced360286e3]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:37:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3e3d772f-9a82-4108-b53d-454356c1c35d tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:17 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dc0fa0c9-8918-4aa4-8af5-9171e5086c57 tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.726s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:17 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-dc0fa0c9-8918-4aa4-8af5-9171e5086c57 tempest-VolumesSnapshotTestJSON-1399893733 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:37:17 devstack sudo[98953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1 Jun 04 06:37:17 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:17 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-dc0fa0c9-8918-4aa4-8af5-9171e5086c57 tempest-VolumesSnapshotTestJSON-1399893733 None] Deleted volume successfully. Jun 04 06:37:17 devstack sudo[98954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689 Jun 04 06:37:17 devstack sudo[98954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:17 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-dc0fa0c9-8918-4aa4-8af5-9171e5086c57 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-08f5d425-76f0-4de3-91e2-f9e145589287-delete_volume" released by "delete_volume" :: held 2.657s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:37:17 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9da66133-8b7c-45cd-8c48-6bb5e890c1d4 tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1" returned: 0 in 1.081s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9da66133-8b7c-45cd-8c48-6bb5e890c1d4 tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:18 devstack sudo[99014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1 Jun 04 06:37:18 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:18 devstack sudo[98954]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3e3d772f-9a82-4108-b53d-454356c1c35d tempest-VolumesExtendTest-325376471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689" returned: 0 in 1.108s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3e3d772f-9a82-4108-b53d-454356c1c35d tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:18 devstack sudo[99018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689 Jun 04 06:37:18 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:18 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9da66133-8b7c-45cd-8c48-6bb5e890c1d4 tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-56a08760-5686-43ee-aa09-446cd6b7a6f1" returned: 0 in 0.925s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:18 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9da66133-8b7c-45cd-8c48-6bb5e890c1d4 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-quobyte-56a08760-5686-43ee-aa09-446cd6b7a6f1" released by "delete_volume" :: held 2.119s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:37:18 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3e3d772f-9a82-4108-b53d-454356c1c35d tempest-VolumesExtendTest-325376471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689" returned: 1 in 0.946s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3e3d772f-9a82-4108-b53d-454356c1c35d tempest-VolumesExtendTest-325376471 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:37:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3e3d772f-9a82-4108-b53d-454356c1c35d tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689 2G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:19 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-9da66133-8b7c-45cd-8c48-6bb5e890c1d4 tempest-VolumesSnapshotTestJSON-1399893733 None] Created reservations ['d8754b67-9485-4ea7-9a35-361ade199d2b', 'fe95fc4a-662f-4911-8c20-6809b1bf8b1b', 'ef52d179-e6e7-4001-8f2e-658dbd288095', 'e31d4c9c-b620-4d7d-bfdd-f137a6ff8fb7'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:37:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3e3d772f-9a82-4108-b53d-454356c1c35d tempest-VolumesExtendTest-325376471 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689 2G" returned: 0 in 0.103s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-3e3d772f-9a82-4108-b53d-454356c1c35d tempest-VolumesExtendTest-325376471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.215s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:37:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9da66133-8b7c-45cd-8c48-6bb5e890c1d4 tempest-VolumesSnapshotTestJSON-1399893733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:37:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9da66133-8b7c-45cd-8c48-6bb5e890c1d4 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:37:19 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-9da66133-8b7c-45cd-8c48-6bb5e890c1d4 tempest-VolumesSnapshotTestJSON-1399893733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:37:19 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-9da66133-8b7c-45cd-8c48-6bb5e890c1d4 tempest-VolumesSnapshotTestJSON-1399893733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:37:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9da66133-8b7c-45cd-8c48-6bb5e890c1d4 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:37:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9da66133-8b7c-45cd-8c48-6bb5e890c1d4 tempest-VolumesSnapshotTestJSON-1399893733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:19 devstack sudo[99037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:37:19 devstack sudo[99037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:19 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-3e3d772f-9a82-4108-b53d-454356c1c35d tempest-VolumesExtendTest-325376471 None] Extend volume completed successfully. Jun 04 06:37:19 devstack sudo[99037]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9da66133-8b7c-45cd-8c48-6bb5e890c1d4 tempest-VolumesSnapshotTestJSON-1399893733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.726s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:19 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-9da66133-8b7c-45cd-8c48-6bb5e890c1d4 tempest-VolumesSnapshotTestJSON-1399893733 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:37:19 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-9da66133-8b7c-45cd-8c48-6bb5e890c1d4 tempest-VolumesSnapshotTestJSON-1399893733 None] Deleted volume successfully. Jun 04 06:37:19 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9da66133-8b7c-45cd-8c48-6bb5e890c1d4 tempest-VolumesSnapshotTestJSON-1399893733 None] Lock "cinder-56a08760-5686-43ee-aa09-446cd6b7a6f1-delete_volume" released by "delete_volume" :: held 3.206s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:37:20 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-20c915ac-4745-4587-a74f-3b2d005e656c tempest-VolumesExtendTest-325376471 None] Acquiring lock "cinder-c805a26e-5b77-4eb7-afbf-def10f8db689-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:37:20 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-20c915ac-4745-4587-a74f-3b2d005e656c tempest-VolumesExtendTest-325376471 None] Lock "cinder-c805a26e-5b77-4eb7-afbf-def10f8db689-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:37:20 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-20c915ac-4745-4587-a74f-3b2d005e656c tempest-VolumesExtendTest-325376471 None] Acquiring lock "cinder-quobyte-c805a26e-5b77-4eb7-afbf-def10f8db689" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:37:20 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-20c915ac-4745-4587-a74f-3b2d005e656c tempest-VolumesExtendTest-325376471 None] Lock "cinder-quobyte-c805a26e-5b77-4eb7-afbf-def10f8db689" acquired by "delete_volume" :: waited 0.024s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:37:20 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d48a7a9-4412-46b4-85db-e14a59b146b0]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:37:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-20c915ac-4745-4587-a74f-3b2d005e656c tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:20 devstack sudo[99040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689 Jun 04 06:37:20 devstack sudo[99040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:21 devstack sudo[99040]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-20c915ac-4745-4587-a74f-3b2d005e656c tempest-VolumesExtendTest-325376471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689" returned: 0 in 0.904s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-20c915ac-4745-4587-a74f-3b2d005e656c tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:21 devstack sudo[99045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689 Jun 04 06:37:21 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:22 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-20c915ac-4745-4587-a74f-3b2d005e656c tempest-VolumesExtendTest-325376471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689" returned: 1 in 0.902s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-20c915ac-4745-4587-a74f-3b2d005e656c tempest-VolumesExtendTest-325376471 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:37:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-20c915ac-4745-4587-a74f-3b2d005e656c tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:22 devstack sudo[99051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689 Jun 04 06:37:22 devstack sudo[99051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:23 devstack sudo[99051]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-20c915ac-4745-4587-a74f-3b2d005e656c tempest-VolumesExtendTest-325376471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c805a26e-5b77-4eb7-afbf-def10f8db689" returned: 0 in 0.887s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:23 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-20c915ac-4745-4587-a74f-3b2d005e656c tempest-VolumesExtendTest-325376471 None] Lock "cinder-quobyte-c805a26e-5b77-4eb7-afbf-def10f8db689" released by "delete_volume" :: held 2.786s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:37:23 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:INSERT=41,cinder:UPDATE=118,cinder:SELECT=92,cinder:DELETE=12 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:37:23 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-20c915ac-4745-4587-a74f-3b2d005e656c tempest-VolumesExtendTest-325376471 None] Created reservations ['4972ea7f-5da6-43b9-8e13-d1ee9a11d361', 'ec3018d9-a278-4c47-a743-2ca342024456', '5004241a-3b5b-4950-9af8-dc3905213d37', 'b4f3bca3-90aa-4a9a-8613-cb75e847c602'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:37:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-20c915ac-4745-4587-a74f-3b2d005e656c tempest-VolumesExtendTest-325376471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:37:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-20c915ac-4745-4587-a74f-3b2d005e656c tempest-VolumesExtendTest-325376471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:37:23 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-20c915ac-4745-4587-a74f-3b2d005e656c tempest-VolumesExtendTest-325376471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:37:23 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-20c915ac-4745-4587-a74f-3b2d005e656c tempest-VolumesExtendTest-325376471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:37:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-20c915ac-4745-4587-a74f-3b2d005e656c tempest-VolumesExtendTest-325376471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:37:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-20c915ac-4745-4587-a74f-3b2d005e656c tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:23 devstack sudo[99057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:37:23 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:24 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-20c915ac-4745-4587-a74f-3b2d005e656c tempest-VolumesExtendTest-325376471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.035s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:24 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-20c915ac-4745-4587-a74f-3b2d005e656c tempest-VolumesExtendTest-325376471 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:37:24 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-20c915ac-4745-4587-a74f-3b2d005e656c tempest-VolumesExtendTest-325376471 None] Deleted volume successfully. Jun 04 06:37:24 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-20c915ac-4745-4587-a74f-3b2d005e656c tempest-VolumesExtendTest-325376471 None] Lock "cinder-c805a26e-5b77-4eb7-afbf-def10f8db689-delete_volume" released by "delete_volume" :: held 4.163s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:37:24 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:37:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] Flow 'volume_create_manager' (12d78fad-d2d3-420a-9c5f-f6914ab7da35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:37:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc55137b-0ad4-460e-bbe9-75125d87c242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc55137b-0ad4-460e-bbe9-75125d87c242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1981928959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec18ad0-62bd-48ae-9ef7-bff96753c5ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1779416a67846c5a1e175bf2381e1f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:37:25Z,use_quota=True,user_id='290e4899480446708d46261103f6aa31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9216abe1-4d6d-49d2-a28d-daa6d4f66ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9216abe1-4d6d-49d2-a28d-daa6d4f66ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a10141e-ccb3-48ed-97db-98e4c4e78586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a10141e-ccb3-48ed-97db-98e4c4e78586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ec18ad0-62bd-48ae-9ef7-bff96753c5ca', 'volume_name': 'volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a94cd9b8-f68c-4a3b-aea1-b758c5ab2d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a94cd9b8-f68c-4a3b-aea1-b758c5ab2d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (426eb0df-a425-4862-9750-e1568da47966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:24 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] Volume 7ec18ad0-62bd-48ae-9ef7-bff96753c5ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca', 'volume_size': 1} Jun 04 06:37:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:37:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:37:24 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1981928959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec18ad0-62bd-48ae-9ef7-bff96753c5ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1779416a67846c5a1e175bf2381e1f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:37:25Z,use_quota=True,user_id='290e4899480446708d46261103f6aa31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:37:24 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] Creating volume 7ec18ad0-62bd-48ae-9ef7-bff96753c5ca {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:37:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:37:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:37:24 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:37:24 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:37:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:37:24 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:37:24 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:37:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:24 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca 1073741824 Jun 04 06:37:24 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:25 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca 1073741824" returned: 0 in 0.886s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:25 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca Jun 04 06:37:25 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:26 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca" returned: 0 in 0.729s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:26 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:37:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:37:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (426eb0df-a425-4862-9750-e1568da47966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d5cdac4-dc9e-4b52-932f-ba0943ef0e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:26 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] Volume volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca (7ec18ad0-62bd-48ae-9ef7-bff96753c5ca): created successfully Jun 04 06:37:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d5cdac4-dc9e-4b52-932f-ba0943ef0e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] Flow 'volume_create_manager' (12d78fad-d2d3-420a-9c5f-f6914ab7da35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:37:26 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-c19f31fc-b75a-4284-9f33-998e051cebd9 tempest-VolumesExtendTest-325376471 None] Created volume successfully. Jun 04 06:37:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-4dab76ca-3f74-44a0-8bf0-d4fad5d2c543 tempest-VolumesExtendTest-325376471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:37:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-4dab76ca-3f74-44a0-8bf0-d4fad5d2c543 tempest-VolumesExtendTest-325376471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:37:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-4dab76ca-3f74-44a0-8bf0-d4fad5d2c543 tempest-VolumesExtendTest-325376471 None] Creating offline snapshot 43e4f99f-a128-4134-ae74-625bc64c4228 of volume 7ec18ad0-62bd-48ae-9ef7-bff96753c5ca {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:37:27 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c8f9e3-8ef2-459b-8c17-d10e1d7ce643]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:37:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4dab76ca-3f74-44a0-8bf0-d4fad5d2c543 tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:27 devstack sudo[99071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca Jun 04 06:37:27 devstack sudo[99071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:28 devstack sudo[99071]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4dab76ca-3f74-44a0-8bf0-d4fad5d2c543 tempest-VolumesExtendTest-325376471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca" returned: 0 in 0.810s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4dab76ca-3f74-44a0-8bf0-d4fad5d2c543 tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca.43e4f99f-a128-4134-ae74-625bc64c4228 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:28 devstack sudo[99076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca.43e4f99f-a128-4134-ae74-625bc64c4228 1G Jun 04 06:37:28 devstack sudo[99076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:28 devstack sudo[99076]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4dab76ca-3f74-44a0-8bf0-d4fad5d2c543 tempest-VolumesExtendTest-325376471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca.43e4f99f-a128-4134-ae74-625bc64c4228 1G" returned: 0 in 0.944s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4dab76ca-3f74-44a0-8bf0-d4fad5d2c543 tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca.43e4f99f-a128-4134-ae74-625bc64c4228 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:29 devstack sudo[99083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca.43e4f99f-a128-4134-ae74-625bc64c4228 Jun 04 06:37:29 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:29 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4dab76ca-3f74-44a0-8bf0-d4fad5d2c543 tempest-VolumesExtendTest-325376471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca.43e4f99f-a128-4134-ae74-625bc64c4228" returned: 0 in 0.810s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:29 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-4dab76ca-3f74-44a0-8bf0-d4fad5d2c543 tempest-VolumesExtendTest-325376471 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca.43e4f99f-a128-4134-ae74-625bc64c4228 is being set with open permissions: ugo+rw Jun 04 06:37:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4dab76ca-3f74-44a0-8bf0-d4fad5d2c543 tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca.43e4f99f-a128-4134-ae74-625bc64c4228 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:29 devstack sudo[99123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca.43e4f99f-a128-4134-ae74-625bc64c4228 Jun 04 06:37:29 devstack sudo[99123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:30 devstack sudo[99123]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4dab76ca-3f74-44a0-8bf0-d4fad5d2c543 tempest-VolumesExtendTest-325376471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca.43e4f99f-a128-4134-ae74-625bc64c4228" returned: 0 in 0.733s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4dab76ca-3f74-44a0-8bf0-d4fad5d2c543 tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:30 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca.info Jun 04 06:37:30 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:31 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4dab76ca-3f74-44a0-8bf0-d4fad5d2c543 tempest-VolumesExtendTest-325376471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca.info" returned: 0 in 0.768s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:31 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-4dab76ca-3f74-44a0-8bf0-d4fad5d2c543 tempest-VolumesExtendTest-325376471 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca.info is being set with open permissions: ugo+rw Jun 04 06:37:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4dab76ca-3f74-44a0-8bf0-d4fad5d2c543 tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:31 devstack sudo[99147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca.info Jun 04 06:37:31 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:32 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4dab76ca-3f74-44a0-8bf0-d4fad5d2c543 tempest-VolumesExtendTest-325376471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca.info" returned: 0 in 0.671s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-4dab76ca-3f74-44a0-8bf0-d4fad5d2c543 tempest-VolumesExtendTest-325376471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.845s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:37:32 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-4dab76ca-3f74-44a0-8bf0-d4fad5d2c543 tempest-VolumesExtendTest-325376471 None] Create snapshot completed successfully Jun 04 06:37:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ec94eb8c-2ffa-4fda-8029-65e8347c9f3d tempest-VolumesExtendTest-325376471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:37:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ec94eb8c-2ffa-4fda-8029-65e8347c9f3d tempest-VolumesExtendTest-325376471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:37:32 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[803bd92c-e84a-4904-a627-b34b5f099185]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:37:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ec94eb8c-2ffa-4fda-8029-65e8347c9f3d tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:32 devstack sudo[99150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca Jun 04 06:37:32 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:33 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ec94eb8c-2ffa-4fda-8029-65e8347c9f3d tempest-VolumesExtendTest-325376471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca" returned: 0 in 0.789s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ec94eb8c-2ffa-4fda-8029-65e8347c9f3d tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca.43e4f99f-a128-4134-ae74-625bc64c4228 2G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ec94eb8c-2ffa-4fda-8029-65e8347c9f3d tempest-VolumesExtendTest-325376471 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca.43e4f99f-a128-4134-ae74-625bc64c4228 2G" returned: 0 in 0.155s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ec94eb8c-2ffa-4fda-8029-65e8347c9f3d tempest-VolumesExtendTest-325376471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.979s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:37:33 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-ec94eb8c-2ffa-4fda-8029-65e8347c9f3d tempest-VolumesExtendTest-325376471 None] Extend volume completed successfully. Jun 04 06:37:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1b2bcd1a-7ffb-4612-b026-b2619f9f5cef tempest-VolumesExtendTest-325376471 None] Acquiring lock "cinder-43e4f99f-a128-4134-ae74-625bc64c4228-delete_snapshot" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:37:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1b2bcd1a-7ffb-4612-b026-b2619f9f5cef tempest-VolumesExtendTest-325376471 None] Lock "cinder-43e4f99f-a128-4134-ae74-625bc64c4228-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:37:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1b2bcd1a-7ffb-4612-b026-b2619f9f5cef tempest-VolumesExtendTest-325376471 None] Acquiring lock "cinder-quobyte-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:37:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1b2bcd1a-7ffb-4612-b026-b2619f9f5cef tempest-VolumesExtendTest-325376471 None] Lock "cinder-quobyte-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:37:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1b2bcd1a-7ffb-4612-b026-b2619f9f5cef tempest-VolumesExtendTest-325376471 None] Acquiring lock "cinder-quobyte-43e4f99f-a128-4134-ae74-625bc64c4228" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:37:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1b2bcd1a-7ffb-4612-b026-b2619f9f5cef tempest-VolumesExtendTest-325376471 None] Lock "cinder-quobyte-43e4f99f-a128-4134-ae74-625bc64c4228" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:37:33 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-1b2bcd1a-7ffb-4612-b026-b2619f9f5cef tempest-VolumesExtendTest-325376471 None] Deleting offline snapshot 43e4f99f-a128-4134-ae74-625bc64c4228 of volume 7ec18ad0-62bd-48ae-9ef7-bff96753c5ca {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:37:33 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-1b2bcd1a-7ffb-4612-b026-b2619f9f5cef tempest-VolumesExtendTest-325376471 None] snapshot_file for this snap is: volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca.43e4f99f-a128-4134-ae74-625bc64c4228 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:37:33 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3a3bdd-cb89-43d4-8fa7-f631d526005d]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:37:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1b2bcd1a-7ffb-4612-b026-b2619f9f5cef tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca.43e4f99f-a128-4134-ae74-625bc64c4228 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:34 devstack sudo[99159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca.43e4f99f-a128-4134-ae74-625bc64c4228 Jun 04 06:37:34 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:34 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1b2bcd1a-7ffb-4612-b026-b2619f9f5cef tempest-VolumesExtendTest-325376471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca.43e4f99f-a128-4134-ae74-625bc64c4228" returned: 0 in 0.769s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-1b2bcd1a-7ffb-4612-b026-b2619f9f5cef tempest-VolumesExtendTest-325376471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:37:34 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec6de35-b039-4405-9bcd-02bc6212d065]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:37:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1b2bcd1a-7ffb-4612-b026-b2619f9f5cef tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:34 devstack sudo[99170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca Jun 04 06:37:34 devstack sudo[99170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:35 devstack sudo[99170]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1b2bcd1a-7ffb-4612-b026-b2619f9f5cef tempest-VolumesExtendTest-325376471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca" returned: 0 in 0.767s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1b2bcd1a-7ffb-4612-b026-b2619f9f5cef tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca.43e4f99f-a128-4134-ae74-625bc64c4228 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:35 devstack sudo[99175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca.43e4f99f-a128-4134-ae74-625bc64c4228 Jun 04 06:37:35 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:36 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1b2bcd1a-7ffb-4612-b026-b2619f9f5cef tempest-VolumesExtendTest-325376471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca.43e4f99f-a128-4134-ae74-625bc64c4228" returned: 0 in 0.773s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1b2bcd1a-7ffb-4612-b026-b2619f9f5cef tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca.43e4f99f-a128-4134-ae74-625bc64c4228 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:36 devstack sudo[99181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca.43e4f99f-a128-4134-ae74-625bc64c4228 Jun 04 06:37:36 devstack sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:36 devstack sudo[99181]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1b2bcd1a-7ffb-4612-b026-b2619f9f5cef tempest-VolumesExtendTest-325376471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca.43e4f99f-a128-4134-ae74-625bc64c4228" returned: 0 in 0.626s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:36 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1b2bcd1a-7ffb-4612-b026-b2619f9f5cef tempest-VolumesExtendTest-325376471 None] Lock "cinder-quobyte-43e4f99f-a128-4134-ae74-625bc64c4228" released by "_delete_snapshot" :: held 3.073s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:37:36 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1b2bcd1a-7ffb-4612-b026-b2619f9f5cef tempest-VolumesExtendTest-325376471 None] Lock "cinder-quobyte-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca" released by "delete_snapshot" :: held 3.102s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:37:37 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-1b2bcd1a-7ffb-4612-b026-b2619f9f5cef tempest-VolumesExtendTest-325376471 None] Created reservations ['0d897d62-4e1f-430f-9d33-00047956d3e9', '9db58502-ebaa-4672-bd67-42471052a3ec', '61b0b6fa-e522-4eb7-be95-0333c4b3564e', '906b53db-b8ed-4be9-97ef-1778607581b8'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:37:37 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-1b2bcd1a-7ffb-4612-b026-b2619f9f5cef tempest-VolumesExtendTest-325376471 None] Delete snapshot completed successfully. Jun 04 06:37:37 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1b2bcd1a-7ffb-4612-b026-b2619f9f5cef tempest-VolumesExtendTest-325376471 None] Lock "cinder-43e4f99f-a128-4134-ae74-625bc64c4228-delete_snapshot" released by "delete_snapshot" :: held 3.276s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:37:38 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-96798756-9a4f-4e55-9154-5a7caf21a407 tempest-VolumesExtendTest-325376471 None] Acquiring lock "cinder-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:37:38 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-96798756-9a4f-4e55-9154-5a7caf21a407 tempest-VolumesExtendTest-325376471 None] Lock "cinder-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:37:38 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-96798756-9a4f-4e55-9154-5a7caf21a407 tempest-VolumesExtendTest-325376471 None] Acquiring lock "cinder-quobyte-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:37:38 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-96798756-9a4f-4e55-9154-5a7caf21a407 tempest-VolumesExtendTest-325376471 None] Lock "cinder-quobyte-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca" acquired by "delete_volume" :: waited 0.025s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:37:38 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b92949-ffbf-4620-89a5-bf5bc6a06d4b]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:37:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-96798756-9a4f-4e55-9154-5a7caf21a407 tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:38 devstack sudo[99185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca Jun 04 06:37:38 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:39 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-96798756-9a4f-4e55-9154-5a7caf21a407 tempest-VolumesExtendTest-325376471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca" returned: 0 in 0.931s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-96798756-9a4f-4e55-9154-5a7caf21a407 tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:39 devstack sudo[99191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca Jun 04 06:37:39 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:40 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-96798756-9a4f-4e55-9154-5a7caf21a407 tempest-VolumesExtendTest-325376471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca" returned: 0 in 0.753s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:40 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-96798756-9a4f-4e55-9154-5a7caf21a407 tempest-VolumesExtendTest-325376471 None] Lock "cinder-quobyte-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca" released by "delete_volume" :: held 1.764s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:37:40 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-96798756-9a4f-4e55-9154-5a7caf21a407 tempest-VolumesExtendTest-325376471 None] Created reservations ['3a75df5e-a4b0-4467-9d6c-e8468248c7a6', 'f30c5c74-fffb-42c4-9882-9831b2ca2df7', '74201975-4de8-4afc-9b50-ff80488393ff', 'aa1f926a-eb5c-4d4b-858b-f06ec2f3e182'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:37:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-96798756-9a4f-4e55-9154-5a7caf21a407 tempest-VolumesExtendTest-325376471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:37:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-96798756-9a4f-4e55-9154-5a7caf21a407 tempest-VolumesExtendTest-325376471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:37:40 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-96798756-9a4f-4e55-9154-5a7caf21a407 tempest-VolumesExtendTest-325376471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:37:40 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-96798756-9a4f-4e55-9154-5a7caf21a407 tempest-VolumesExtendTest-325376471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:37:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-96798756-9a4f-4e55-9154-5a7caf21a407 tempest-VolumesExtendTest-325376471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:37:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-96798756-9a4f-4e55-9154-5a7caf21a407 tempest-VolumesExtendTest-325376471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:40 devstack sudo[99194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:37:40 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:40 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-96798756-9a4f-4e55-9154-5a7caf21a407 tempest-VolumesExtendTest-325376471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.675s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:40 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-96798756-9a4f-4e55-9154-5a7caf21a407 tempest-VolumesExtendTest-325376471 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:37:40 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-96798756-9a4f-4e55-9154-5a7caf21a407 tempest-VolumesExtendTest-325376471 None] Deleted volume successfully. Jun 04 06:37:40 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-96798756-9a4f-4e55-9154-5a7caf21a407 tempest-VolumesExtendTest-325376471 None] Lock "cinder-7ec18ad0-62bd-48ae-9ef7-bff96753c5ca-delete_volume" released by "delete_volume" :: held 2.744s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=81,cinder:UPDATE=101,cinder:INSERT=30,cinder:DELETE=5 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] Flow 'volume_create_manager' (265c52dc-563d-4996-8ee0-3948464f00a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b86b20-29c6-42b5-aaa5-367e022f8d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b86b20-29c6-42b5-aaa5-367e022f8d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-137471946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16f53722-1fb8-4dfd-bf23-79aed72253f1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ccd221c4edfc4f6e97b2c7d1828daef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:37:43Z,use_quota=True,user_id='47c74540fd7247e0ae8710e9573b8497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3332984-3c1e-4322-9089-f9212282352b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3332984-3c1e-4322-9089-f9212282352b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa19446-97af-46f1-994f-fa3bff49bf39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa19446-97af-46f1-994f-fa3bff49bf39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16f53722-1fb8-4dfd-bf23-79aed72253f1', 'volume_name': 'volume-16f53722-1fb8-4dfd-bf23-79aed72253f1', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e4baed-7762-4da2-8ff0-dcff2762a3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e4baed-7762-4da2-8ff0-dcff2762a3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be314526-91e3-41c0-85fe-3f45e494874f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:43 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] Volume 16f53722-1fb8-4dfd-bf23-79aed72253f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16f53722-1fb8-4dfd-bf23-79aed72253f1', 'volume_size': 1} Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-137471946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16f53722-1fb8-4dfd-bf23-79aed72253f1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ccd221c4edfc4f6e97b2c7d1828daef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:37:43Z,use_quota=True,user_id='47c74540fd7247e0ae8710e9573b8497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] Creating volume 16f53722-1fb8-4dfd-bf23-79aed72253f1 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:37:43 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-16f53722-1fb8-4dfd-bf23-79aed72253f1 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:43 devstack sudo[99200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-16f53722-1fb8-4dfd-bf23-79aed72253f1 1073741824 Jun 04 06:37:43 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] Flow 'volume_create_manager' (67bcc733-6cf6-4909-9455-723e10ed8807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6259d627-0a13-48b9-b301-aab13936ab66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6259d627-0a13-48b9-b301-aab13936ab66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-445437552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b96625e2-6104-430a-b8c2-3da6e012e443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f25af5158a894c938d0626b709972d27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:37:44Z,use_quota=True,user_id='515dd6f58ec3452d8daea2d739ebce01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f197546-6405-44c9-a68c-799410c2ad92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f197546-6405-44c9-a68c-799410c2ad92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07bc6eed-dec0-44e8-ad2b-8974baf812fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07bc6eed-dec0-44e8-ad2b-8974baf812fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b96625e2-6104-430a-b8c2-3da6e012e443', 'volume_name': 'volume-b96625e2-6104-430a-b8c2-3da6e012e443', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6e93c0e-2b6a-420c-af6b-ec1d3eec46ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6e93c0e-2b6a-420c-af6b-ec1d3eec46ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04f8e4ba-9c2f-438f-b36d-b97f2f5d9719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:43 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] Volume b96625e2-6104-430a-b8c2-3da6e012e443: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b96625e2-6104-430a-b8c2-3da6e012e443', 'volume_size': 1} Jun 04 06:37:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:37:44 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-16f53722-1fb8-4dfd-bf23-79aed72253f1 1073741824" returned: 0 in 0.865s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-16f53722-1fb8-4dfd-bf23-79aed72253f1 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:44 devstack sudo[99206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-16f53722-1fb8-4dfd-bf23-79aed72253f1 Jun 04 06:37:44 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:45 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-16f53722-1fb8-4dfd-bf23-79aed72253f1" returned: 0 in 0.665s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:45 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:37:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:37:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.459s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:37:45 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-445437552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b96625e2-6104-430a-b8c2-3da6e012e443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f25af5158a894c938d0626b709972d27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:37:44Z,use_quota=True,user_id='515dd6f58ec3452d8daea2d739ebce01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:37:45 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] Creating volume b96625e2-6104-430a-b8c2-3da6e012e443 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:37:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:37:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:37:45 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:37:45 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:37:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:37:45 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:37:45 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:37:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b96625e2-6104-430a-b8c2-3da6e012e443 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be314526-91e3-41c0-85fe-3f45e494874f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16f53722-1fb8-4dfd-bf23-79aed72253f1', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abebc2c6-9d09-4f64-bab7-ef8ad6acb7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:45 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b96625e2-6104-430a-b8c2-3da6e012e443 1073741824 Jun 04 06:37:45 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:45 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] Volume volume-16f53722-1fb8-4dfd-bf23-79aed72253f1 (16f53722-1fb8-4dfd-bf23-79aed72253f1): created successfully Jun 04 06:37:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abebc2c6-9d09-4f64-bab7-ef8ad6acb7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] Flow 'volume_create_manager' (265c52dc-563d-4996-8ee0-3948464f00a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:37:45 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-786fc967-ac9b-4f8e-a51e-74bde788a62a tempest-VolumesGetTest-1957083593 None] Created volume successfully. Jun 04 06:37:46 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b96625e2-6104-430a-b8c2-3da6e012e443 1073741824" returned: 0 in 1.186s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b96625e2-6104-430a-b8c2-3da6e012e443 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:46 devstack sudo[99215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b96625e2-6104-430a-b8c2-3da6e012e443 Jun 04 06:37:46 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:46 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:37:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] Flow 'volume_create_manager' (b15bd742-cf2a-4e73-88fa-731bc0dab50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:37:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3140b17f-3fcc-43a7-b15d-098564fde258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3140b17f-3fcc-43a7-b15d-098564fde258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:37:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-178804253',display_name='tempest-VolumesGetTest-Volume-886545302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34c9a432-1ef8-4207-a402-2455d660c749,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccd221c4edfc4f6e97b2c7d1828daef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:37:46Z,use_quota=True,user_id='47c74540fd7247e0ae8710e9573b8497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a29c939b-db4f-4d23-8b35-9806093848d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a29c939b-db4f-4d23-8b35-9806093848d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b621ea5b-e3aa-460a-9d49-80cb84f25f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b621ea5b-e3aa-460a-9d49-80cb84f25f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34c9a432-1ef8-4207-a402-2455d660c749', 'volume_name': 'volume-34c9a432-1ef8-4207-a402-2455d660c749', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87d8c960-5e4e-4641-bd70-829068fbab42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87d8c960-5e4e-4641-bd70-829068fbab42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad750130-f8c3-4365-b3a3-5cd9fcdd7395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:46 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] Volume 34c9a432-1ef8-4207-a402-2455d660c749: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34c9a432-1ef8-4207-a402-2455d660c749', 'volume_size': 1} Jun 04 06:37:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:37:47 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b96625e2-6104-430a-b8c2-3da6e012e443" returned: 0 in 0.758s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:47 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] <== create_volume: return (2004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:37:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:37:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.583s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:37:47 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:37:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-178804253',display_name='tempest-VolumesGetTest-Volume-886545302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34c9a432-1ef8-4207-a402-2455d660c749,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccd221c4edfc4f6e97b2c7d1828daef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:37:46Z,use_quota=True,user_id='47c74540fd7247e0ae8710e9573b8497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:37:47 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] Creating volume 34c9a432-1ef8-4207-a402-2455d660c749 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:37:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:37:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:37:47 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:37:47 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:37:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:37:47 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:37:47 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:37:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34c9a432-1ef8-4207-a402-2455d660c749 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:47 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34c9a432-1ef8-4207-a402-2455d660c749 1073741824 Jun 04 06:37:47 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04f8e4ba-9c2f-438f-b36d-b97f2f5d9719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b96625e2-6104-430a-b8c2-3da6e012e443', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (953c1b61-7765-4e07-81e5-e376ae39ffbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:47 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] Volume volume-b96625e2-6104-430a-b8c2-3da6e012e443 (b96625e2-6104-430a-b8c2-3da6e012e443): created successfully Jun 04 06:37:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (953c1b61-7765-4e07-81e5-e376ae39ffbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] Flow 'volume_create_manager' (67bcc733-6cf6-4909-9455-723e10ed8807) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:37:47 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-087e0552-05f5-46d9-b89e-fbd8deb1ecc1 tempest-AttachVolumeShelveTestJSON-2104168720 None] Created volume successfully. Jun 04 06:37:48 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34c9a432-1ef8-4207-a402-2455d660c749 1073741824" returned: 0 in 1.114s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34c9a432-1ef8-4207-a402-2455d660c749 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:48 devstack sudo[99229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34c9a432-1ef8-4207-a402-2455d660c749 Jun 04 06:37:48 devstack sudo[99229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:49 devstack sudo[99229]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34c9a432-1ef8-4207-a402-2455d660c749" returned: 0 in 0.694s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:49 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:37:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:37:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad750130-f8c3-4365-b3a3-5cd9fcdd7395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34c9a432-1ef8-4207-a402-2455d660c749', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67ab05f6-3ab6-4bf6-a6da-8ee04b93a665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:49 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] Volume volume-34c9a432-1ef8-4207-a402-2455d660c749 (34c9a432-1ef8-4207-a402-2455d660c749): created successfully Jun 04 06:37:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67ab05f6-3ab6-4bf6-a6da-8ee04b93a665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] Flow 'volume_create_manager' (b15bd742-cf2a-4e73-88fa-731bc0dab50d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:37:49 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-ec128064-aca7-4cbc-861a-b73ba2fc8edd tempest-VolumesGetTest-1957083593 None] Created volume successfully. Jun 04 06:37:49 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d86e8595-1557-44ab-a637-b939e4ef34b3 tempest-VolumesGetTest-1957083593 None] Acquiring lock "cinder-34c9a432-1ef8-4207-a402-2455d660c749-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:37:50 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d86e8595-1557-44ab-a637-b939e4ef34b3 tempest-VolumesGetTest-1957083593 None] Lock "cinder-34c9a432-1ef8-4207-a402-2455d660c749-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:37:50 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d86e8595-1557-44ab-a637-b939e4ef34b3 tempest-VolumesGetTest-1957083593 None] Acquiring lock "cinder-quobyte-34c9a432-1ef8-4207-a402-2455d660c749" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:37:50 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d86e8595-1557-44ab-a637-b939e4ef34b3 tempest-VolumesGetTest-1957083593 None] Lock "cinder-quobyte-34c9a432-1ef8-4207-a402-2455d660c749" acquired by "delete_volume" :: waited 0.019s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:37:50 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc94becf-7c11-4d33-822f-f1523eef67c7]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:37:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d86e8595-1557-44ab-a637-b939e4ef34b3 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34c9a432-1ef8-4207-a402-2455d660c749 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:50 devstack sudo[99232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34c9a432-1ef8-4207-a402-2455d660c749 Jun 04 06:37:50 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:51 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d86e8595-1557-44ab-a637-b939e4ef34b3 tempest-VolumesGetTest-1957083593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34c9a432-1ef8-4207-a402-2455d660c749" returned: 0 in 1.082s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d86e8595-1557-44ab-a637-b939e4ef34b3 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34c9a432-1ef8-4207-a402-2455d660c749 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:51 devstack sudo[99274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34c9a432-1ef8-4207-a402-2455d660c749 Jun 04 06:37:51 devstack sudo[99274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:51 devstack sudo[99274]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d86e8595-1557-44ab-a637-b939e4ef34b3 tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-34c9a432-1ef8-4207-a402-2455d660c749" returned: 0 in 0.670s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:51 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d86e8595-1557-44ab-a637-b939e4ef34b3 tempest-VolumesGetTest-1957083593 None] Lock "cinder-quobyte-34c9a432-1ef8-4207-a402-2455d660c749" released by "delete_volume" :: held 1.803s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:37:51 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-d86e8595-1557-44ab-a637-b939e4ef34b3 tempest-VolumesGetTest-1957083593 None] Created reservations ['d329c1cd-7cdd-4792-a8df-4da740959aca', 'cc6b766f-1084-41d7-b92d-2ab426d9082d', '1432e3f1-f2c6-4332-ad7b-176c996b2712', '448aff8e-73ed-4677-9197-d8f821ff1de8'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:37:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d86e8595-1557-44ab-a637-b939e4ef34b3 tempest-VolumesGetTest-1957083593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:37:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d86e8595-1557-44ab-a637-b939e4ef34b3 tempest-VolumesGetTest-1957083593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:37:52 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d86e8595-1557-44ab-a637-b939e4ef34b3 tempest-VolumesGetTest-1957083593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:37:52 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d86e8595-1557-44ab-a637-b939e4ef34b3 tempest-VolumesGetTest-1957083593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:37:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d86e8595-1557-44ab-a637-b939e4ef34b3 tempest-VolumesGetTest-1957083593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:37:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d86e8595-1557-44ab-a637-b939e4ef34b3 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:52 devstack sudo[99280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:37:52 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:52 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-04b74b9d-b76c-4039-95be-d2395c0bbff5 tempest-VolumesGetTest-1957083593 None] Acquiring lock "cinder-16f53722-1fb8-4dfd-bf23-79aed72253f1-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:37:52 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-04b74b9d-b76c-4039-95be-d2395c0bbff5 tempest-VolumesGetTest-1957083593 None] Lock "cinder-16f53722-1fb8-4dfd-bf23-79aed72253f1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:37:52 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-04b74b9d-b76c-4039-95be-d2395c0bbff5 tempest-VolumesGetTest-1957083593 None] Acquiring lock "cinder-quobyte-16f53722-1fb8-4dfd-bf23-79aed72253f1" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:37:52 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-04b74b9d-b76c-4039-95be-d2395c0bbff5 tempest-VolumesGetTest-1957083593 None] Lock "cinder-quobyte-16f53722-1fb8-4dfd-bf23-79aed72253f1" acquired by "delete_volume" :: waited 0.020s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:37:52 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d223b04-4feb-4afb-905a-1973669ccbd6]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:37:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-04b74b9d-b76c-4039-95be-d2395c0bbff5 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-16f53722-1fb8-4dfd-bf23-79aed72253f1 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:52 devstack sudo[99282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-16f53722-1fb8-4dfd-bf23-79aed72253f1 Jun 04 06:37:52 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:52 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d86e8595-1557-44ab-a637-b939e4ef34b3 tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.849s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:52 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-d86e8595-1557-44ab-a637-b939e4ef34b3 tempest-VolumesGetTest-1957083593 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:37:52 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-d86e8595-1557-44ab-a637-b939e4ef34b3 tempest-VolumesGetTest-1957083593 None] Deleted volume successfully. Jun 04 06:37:52 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d86e8595-1557-44ab-a637-b939e4ef34b3 tempest-VolumesGetTest-1957083593 None] Lock "cinder-34c9a432-1ef8-4207-a402-2455d660c749-delete_volume" released by "delete_volume" :: held 2.909s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:37:53 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-04b74b9d-b76c-4039-95be-d2395c0bbff5 tempest-VolumesGetTest-1957083593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-16f53722-1fb8-4dfd-bf23-79aed72253f1" returned: 0 in 0.791s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-04b74b9d-b76c-4039-95be-d2395c0bbff5 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-16f53722-1fb8-4dfd-bf23-79aed72253f1 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:53 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-16f53722-1fb8-4dfd-bf23-79aed72253f1 Jun 04 06:37:53 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:53 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-04b74b9d-b76c-4039-95be-d2395c0bbff5 tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-16f53722-1fb8-4dfd-bf23-79aed72253f1" returned: 0 in 0.670s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:53 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-04b74b9d-b76c-4039-95be-d2395c0bbff5 tempest-VolumesGetTest-1957083593 None] Lock "cinder-quobyte-16f53722-1fb8-4dfd-bf23-79aed72253f1" released by "delete_volume" :: held 1.505s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:37:54 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-04b74b9d-b76c-4039-95be-d2395c0bbff5 tempest-VolumesGetTest-1957083593 None] Created reservations ['3c8696a4-07dd-4a23-a9e8-01e527bbebfc', 'b8e6d5f2-6f1a-4708-a657-ac205ee3dea0', 'fd4ab114-4cad-4689-ba5e-b74b98f530b6', '24eb021b-24b5-46a6-b2e2-414e418a4bc1'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:37:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-04b74b9d-b76c-4039-95be-d2395c0bbff5 tempest-VolumesGetTest-1957083593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:37:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-04b74b9d-b76c-4039-95be-d2395c0bbff5 tempest-VolumesGetTest-1957083593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:37:54 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-04b74b9d-b76c-4039-95be-d2395c0bbff5 tempest-VolumesGetTest-1957083593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:37:54 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-04b74b9d-b76c-4039-95be-d2395c0bbff5 tempest-VolumesGetTest-1957083593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:37:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-04b74b9d-b76c-4039-95be-d2395c0bbff5 tempest-VolumesGetTest-1957083593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:37:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-04b74b9d-b76c-4039-95be-d2395c0bbff5 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:54 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:37:54 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:54 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-04b74b9d-b76c-4039-95be-d2395c0bbff5 tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.798s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:54 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-04b74b9d-b76c-4039-95be-d2395c0bbff5 tempest-VolumesGetTest-1957083593 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:37:54 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-04b74b9d-b76c-4039-95be-d2395c0bbff5 tempest-VolumesGetTest-1957083593 None] Deleted volume successfully. Jun 04 06:37:54 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-04b74b9d-b76c-4039-95be-d2395c0bbff5 tempest-VolumesGetTest-1957083593 None] Lock "cinder-16f53722-1fb8-4dfd-bf23-79aed72253f1-delete_volume" released by "delete_volume" :: held 2.536s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:37:55 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:37:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] Flow 'volume_create_manager' (c375b911-d816-49c5-a198-f463196fe0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:37:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6c284d6-5582-4e23-b2fd-7edb6fea16d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6c284d6-5582-4e23-b2fd-7edb6fea16d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-297742541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4dcb5bb-3781-4c4e-94f0-4a76fc13de29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccd221c4edfc4f6e97b2c7d1828daef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:37:55Z,use_quota=True,user_id='47c74540fd7247e0ae8710e9573b8497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf462e9-44ba-4dd3-8a1f-55fb1d6051a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf462e9-44ba-4dd3-8a1f-55fb1d6051a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a13858f-1898-43ad-a044-b78e2beab6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a13858f-1898-43ad-a044-b78e2beab6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4dcb5bb-3781-4c4e-94f0-4a76fc13de29', 'volume_name': 'volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (075a1232-6b2c-415a-a2e3-f5969c7104c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (075a1232-6b2c-415a-a2e3-f5969c7104c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c05bd284-23da-4108-8e68-8923d152fc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:55 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] Volume d4dcb5bb-3781-4c4e-94f0-4a76fc13de29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29', 'volume_size': 1} Jun 04 06:37:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:37:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:37:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-297742541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4dcb5bb-3781-4c4e-94f0-4a76fc13de29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccd221c4edfc4f6e97b2c7d1828daef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:37:55Z,use_quota=True,user_id='47c74540fd7247e0ae8710e9573b8497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:37:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] Creating volume d4dcb5bb-3781-4c4e-94f0-4a76fc13de29 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:37:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:37:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:37:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:37:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:37:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:37:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:37:55 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:37:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:55 devstack sudo[99304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29 1073741824 Jun 04 06:37:55 devstack sudo[99304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:56 devstack sudo[99304]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29 1073741824" returned: 0 in 0.928s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:56 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29 Jun 04 06:37:56 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:56 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29" returned: 0 in 0.646s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:57 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:37:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:37:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c05bd284-23da-4108-8e68-8923d152fc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16ad4e5a-80c6-4f1e-b990-91d967ebfca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:57 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] Volume volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29 (d4dcb5bb-3781-4c4e-94f0-4a76fc13de29): created successfully Jun 04 06:37:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16ad4e5a-80c6-4f1e-b990-91d967ebfca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] Flow 'volume_create_manager' (c375b911-d816-49c5-a198-f463196fe0ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:37:57 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-e17b3752-7e3f-4ad0-9490-e286462f32fd tempest-VolumesGetTest-1957083593 None] Created volume successfully. Jun 04 06:37:58 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:37:58 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Flow 'volume_create_manager' (ef78fbd8-5049-46f3-ad3a-26b370702a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:37:58 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b279fadf-f144-4c6f-8ae0-dc7f56742d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:58 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b279fadf-f144-4c6f-8ae0-dc7f56742d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-281031732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bf603fb-999d-4603-833c-4c9449a0be73,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ccd221c4edfc4f6e97b2c7d1828daef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=d4dcb5bb-3781-4c4e-94f0-4a76fc13de29,status='creating',terminated_at=None,updated_at=2026-06-04T04:37:58Z,use_quota=True,user_id='47c74540fd7247e0ae8710e9573b8497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:58 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c44d058-a7fe-4c76-9ce7-6f0b66cd5430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:58 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c44d058-a7fe-4c76-9ce7-6f0b66cd5430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:58 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bab680f-3467-4ce8-92ae-25103eccd83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:58 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bab680f-3467-4ce8-92ae-25103eccd83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9bf603fb-999d-4603-833c-4c9449a0be73', 'volume_name': 'volume-9bf603fb-999d-4603-833c-4c9449a0be73', 'volume_size': 1, 'source_volid': 'd4dcb5bb-3781-4c4e-94f0-4a76fc13de29', 'source_volstatus': 'available'}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:58 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b96b8878-4ea6-4009-bd31-a34f3e4bb7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:58 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b96b8878-4ea6-4009-bd31-a34f3e4bb7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:37:58 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a9c1ed-e8cc-4bdc-b120-8d7f56fbb6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:37:58 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Volume 9bf603fb-999d-4603-833c-4c9449a0be73: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9bf603fb-999d-4603-833c-4c9449a0be73', 'volume_size': 1, 'source_volid': 'd4dcb5bb-3781-4c4e-94f0-4a76fc13de29', 'source_volstatus': 'available'} Jun 04 06:37:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:37:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:37:58 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Cloning volume d4dcb5bb-3781-4c4e-94f0-4a76fc13de29 to volume 9bf603fb-999d-4603-833c-4c9449a0be73 Jun 04 06:37:58 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Creating offline snapshot a35f141f-8504-4ca8-92d0-ae4b05629b00 of volume d4dcb5bb-3781-4c4e-94f0-4a76fc13de29 {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:37:58 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f122edf6-8380-4aed-a167-87413ec43b81]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:37:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:58 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29 Jun 04 06:37:58 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:37:59 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Jun 04 06:37:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29" returned: 0 in 0.797s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:37:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29.a35f141f-8504-4ca8-92d0-ae4b05629b00 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:37:59 devstack sudo[99331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29.a35f141f-8504-4ca8-92d0-ae4b05629b00 1G Jun 04 06:37:59 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:00 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29.a35f141f-8504-4ca8-92d0-ae4b05629b00 1G" returned: 0 in 0.926s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29.a35f141f-8504-4ca8-92d0-ae4b05629b00 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:00 devstack sudo[99343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29.a35f141f-8504-4ca8-92d0-ae4b05629b00 Jun 04 06:38:00 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:00 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29.a35f141f-8504-4ca8-92d0-ae4b05629b00" returned: 0 in 0.706s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:00 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29.a35f141f-8504-4ca8-92d0-ae4b05629b00 is being set with open permissions: ugo+rw Jun 04 06:38:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29.a35f141f-8504-4ca8-92d0-ae4b05629b00 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:00 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29.a35f141f-8504-4ca8-92d0-ae4b05629b00 Jun 04 06:38:00 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:01 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29.a35f141f-8504-4ca8-92d0-ae4b05629b00" returned: 0 in 0.644s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:01 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29.info Jun 04 06:38:01 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:02 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29.info" returned: 0 in 0.752s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:02 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29.info is being set with open permissions: ugo+rw Jun 04 06:38:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:02 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29.info Jun 04 06:38:02 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:02 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29.info" returned: 0 in 0.645s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:02 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Acquiring lock "cinder-quobyte-9bf603fb-999d-4603-833c-4c9449a0be73" by "_copy_volume_from_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:38:02 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Lock "cinder-quobyte-9bf603fb-999d-4603-833c-4c9449a0be73" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:38:02 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] snapshot: a35f141f-8504-4ca8-92d0-ae4b05629b00, volume: 9bf603fb-999d-4603-833c-4c9449a0be73, {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 06:38:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:38:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:38:02 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:38:02 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:38:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:38:02 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[338e2008-c2e3-454d-aed8-22358d058e17]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:38:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29.a35f141f-8504-4ca8-92d0-ae4b05629b00 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:03 devstack sudo[99362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29.a35f141f-8504-4ca8-92d0-ae4b05629b00 Jun 04 06:38:03 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:03 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29.a35f141f-8504-4ca8-92d0-ae4b05629b00" returned: 0 in 0.854s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:03 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:38:03 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29 {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 06:38:03 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Creating direct copy from snapshot {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 06:38:03 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[745072cb-8b65-40f1-a30b-d577c844ae8f]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:38:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:03 devstack sudo[99388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29 Jun 04 06:38:03 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:04 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-4917947f-094d-45cc-890e-8ea9ef0503a2 req-c43a3e66-d84f-4894-9651-fbd15b6a0709 tempest-AttachVolumeShelveTestJSON-2104168720 None] No connector for attachment c72ec2a7-ddde-4fa9-bf22-bcbd105fec58; skipping storage backend terminate_connection call. {{(pid=86069) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5011}} Jun 04 06:38:04 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-4917947f-094d-45cc-890e-8ea9ef0503a2 req-c43a3e66-d84f-4894-9651-fbd15b6a0709 tempest-AttachVolumeShelveTestJSON-2104168720 None] Deleting attachment c72ec2a7-ddde-4fa9-bf22-bcbd105fec58. {{(pid=86069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 06:38:05 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29" returned: 0 in 1.198s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:05 devstack cinder-volume[86069]: DEBUG cinder.utils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Path /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9bf603fb-999d-4603-833c-4c9449a0be73 not found in is_blk_device check {{(pid=86069) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 04 06:38:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9bf603fb-999d-4603-833c-4c9449a0be73 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:05 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9bf603fb-999d-4603-833c-4c9449a0be73 Jun 04 06:38:05 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:38:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:38:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:38:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:38:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:38:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:38:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:11 devstack sudo[99453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:38:11 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:12 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9bf603fb-999d-4603-833c-4c9449a0be73" returned: 0 in 7.958s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:12 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.833s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:13 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:38:13 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager._thread_info {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:38:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread count: 28 {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 06:38:13 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread info: [<_MainThread(MainThread, started 131797370544256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 06:38:13 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[052a0722-c7ad-4dc9-846c-d0ef343c4c6d]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:38:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:13 devstack sudo[99457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29 Jun 04 06:38:13 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:14 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29" returned: 0 in 1.071s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:14 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Image conversion details: src /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29, size 1024.00 MB, duration 7.96 sec, destination /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9bf603fb-999d-4603-833c-4c9449a0be73 {{(pid=86069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 06:38:14 devstack cinder-volume[86069]: INFO cinder.image.image_utils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Converted 1024.00 MB image at 128.59 MB/s Jun 04 06:38:14 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9bf603fb-999d-4603-833c-4c9449a0be73 is being set with open permissions: ugo+rw Jun 04 06:38:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9bf603fb-999d-4603-833c-4c9449a0be73 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:14 devstack sudo[99463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9bf603fb-999d-4603-833c-4c9449a0be73 Jun 04 06:38:14 devstack sudo[99463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:14 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=22,cinder:UPDATE=29,cinder:INSERT=8,cinder:DELETE=3 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:38:14 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=47,cinder:INSERT=13,cinder:UPDATE=63,cinder:DELETE=5 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:38:14 devstack sudo[99463]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9bf603fb-999d-4603-833c-4c9449a0be73" returned: 0 in 0.827s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:14 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Lock "cinder-quobyte-9bf603fb-999d-4603-833c-4c9449a0be73" released by "_copy_volume_from_snapshot" :: held 12.057s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:38:14 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Acquiring lock "cinder-quobyte-a35f141f-8504-4ca8-92d0-ae4b05629b00" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:38:15 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Lock "cinder-quobyte-a35f141f-8504-4ca8-92d0-ae4b05629b00" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:38:15 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Deleting offline snapshot a35f141f-8504-4ca8-92d0-ae4b05629b00 of volume d4dcb5bb-3781-4c4e-94f0-4a76fc13de29 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:38:15 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] snapshot_file for this snap is: volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29.a35f141f-8504-4ca8-92d0-ae4b05629b00 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:38:15 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[da12e8b4-d1fb-4504-8a24-9cc184db53db]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:38:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29.a35f141f-8504-4ca8-92d0-ae4b05629b00 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:15 devstack sudo[99467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29.a35f141f-8504-4ca8-92d0-ae4b05629b00 Jun 04 06:38:15 devstack sudo[99467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:15 devstack sudo[99467]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29.a35f141f-8504-4ca8-92d0-ae4b05629b00" returned: 0 in 0.850s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:15 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:38:15 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff76c57-0401-4f18-bbad-02fc21dd22f8]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:38:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:16 devstack sudo[99481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29 Jun 04 06:38:16 devstack sudo[99481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:16 devstack sudo[99481]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29" returned: 0 in 0.959s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29.a35f141f-8504-4ca8-92d0-ae4b05629b00 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:16 devstack sudo[99488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29.a35f141f-8504-4ca8-92d0-ae4b05629b00 Jun 04 06:38:16 devstack sudo[99488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:17 devstack sudo[99488]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29.a35f141f-8504-4ca8-92d0-ae4b05629b00" returned: 0 in 0.765s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29.a35f141f-8504-4ca8-92d0-ae4b05629b00 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:17 devstack sudo[99493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29.a35f141f-8504-4ca8-92d0-ae4b05629b00 Jun 04 06:38:17 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:18 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29.a35f141f-8504-4ca8-92d0-ae4b05629b00" returned: 0 in 0.930s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:18 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Lock "cinder-quobyte-a35f141f-8504-4ca8-92d0-ae4b05629b00" released by "_delete_snapshot" :: held 3.633s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:38:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.496s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:38:18 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a9c1ed-e8cc-4bdc-b120-8d7f56fbb6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bf603fb-999d-4603-833c-4c9449a0be73', 'volume_size': 1, 'source_volid': 'd4dcb5bb-3781-4c4e-94f0-4a76fc13de29', 'source_volstatus': 'available'}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:38:18 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af625115-54e5-4e5a-bc52-9abd3287dfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:38:18 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Volume volume-9bf603fb-999d-4603-833c-4c9449a0be73 (9bf603fb-999d-4603-833c-4c9449a0be73): created successfully Jun 04 06:38:18 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af625115-54e5-4e5a-bc52-9abd3287dfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:38:18 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Flow 'volume_create_manager' (ef78fbd8-5049-46f3-ad3a-26b370702a1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:38:18 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-41de4488-03ac-4598-a615-97d8aa766177 tempest-VolumesGetTest-1957083593 None] Created volume successfully. Jun 04 06:38:20 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:38:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] Flow 'volume_create_manager' (0cbb298f-ff75-4d2b-9579-0881d956f935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:38:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (809d4dad-dd82-4214-b7de-70d5c05f2f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:38:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (809d4dad-dd82-4214-b7de-70d5c05f2f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:38:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-924210613',display_name='tempest-VolumesGetTest-Volume-2009984618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e68ccec2-53a3-42e3-8c4d-350cf57a82eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccd221c4edfc4f6e97b2c7d1828daef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:38:20Z,use_quota=True,user_id='47c74540fd7247e0ae8710e9573b8497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:38:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fc09cac-bb80-45d3-b2ad-dc8f59249544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:38:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fc09cac-bb80-45d3-b2ad-dc8f59249544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:38:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3023795-967a-4682-b09c-f3154f7e9ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:38:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3023795-967a-4682-b09c-f3154f7e9ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e68ccec2-53a3-42e3-8c4d-350cf57a82eb', 'volume_name': 'volume-e68ccec2-53a3-42e3-8c4d-350cf57a82eb', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:38:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7b8d7cd-c04f-4ba1-a6aa-4811e77e8d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:38:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7b8d7cd-c04f-4ba1-a6aa-4811e77e8d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:38:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f3ac1a-6ca8-45d6-b2a6-7ec9ba8771c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:38:20 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] Volume e68ccec2-53a3-42e3-8c4d-350cf57a82eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e68ccec2-53a3-42e3-8c4d-350cf57a82eb', 'volume_size': 1} Jun 04 06:38:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:38:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:38:20 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:38:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-924210613',display_name='tempest-VolumesGetTest-Volume-2009984618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e68ccec2-53a3-42e3-8c4d-350cf57a82eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccd221c4edfc4f6e97b2c7d1828daef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:38:20Z,use_quota=True,user_id='47c74540fd7247e0ae8710e9573b8497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:38:20 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] Creating volume e68ccec2-53a3-42e3-8c4d-350cf57a82eb {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:38:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:38:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:38:20 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:38:20 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:38:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:38:20 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:38:20 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:38:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e68ccec2-53a3-42e3-8c4d-350cf57a82eb 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:20 devstack sudo[99546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e68ccec2-53a3-42e3-8c4d-350cf57a82eb 1073741824 Jun 04 06:38:20 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:21 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e68ccec2-53a3-42e3-8c4d-350cf57a82eb 1073741824" returned: 0 in 0.802s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e68ccec2-53a3-42e3-8c4d-350cf57a82eb {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:21 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e68ccec2-53a3-42e3-8c4d-350cf57a82eb Jun 04 06:38:21 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:22 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e68ccec2-53a3-42e3-8c4d-350cf57a82eb" returned: 0 in 0.740s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:22 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:38:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:38:22 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f3ac1a-6ca8-45d6-b2a6-7ec9ba8771c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e68ccec2-53a3-42e3-8c4d-350cf57a82eb', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:38:22 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e72af1-d4f1-4f60-ae7d-76a82f0fbf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:38:22 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] Volume volume-e68ccec2-53a3-42e3-8c4d-350cf57a82eb (e68ccec2-53a3-42e3-8c4d-350cf57a82eb): created successfully Jun 04 06:38:22 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e72af1-d4f1-4f60-ae7d-76a82f0fbf44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:38:22 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] Flow 'volume_create_manager' (0cbb298f-ff75-4d2b-9579-0881d956f935) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:38:22 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-ec43a2d0-6150-4667-96cd-b49e31d0b280 tempest-VolumesGetTest-1957083593 None] Created volume successfully. Jun 04 06:38:22 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6c8083a7-6393-4d4e-904b-9276e3cb670c tempest-VolumesGetTest-1957083593 None] Acquiring lock "cinder-e68ccec2-53a3-42e3-8c4d-350cf57a82eb-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:38:22 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6c8083a7-6393-4d4e-904b-9276e3cb670c tempest-VolumesGetTest-1957083593 None] Lock "cinder-e68ccec2-53a3-42e3-8c4d-350cf57a82eb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:38:22 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6c8083a7-6393-4d4e-904b-9276e3cb670c tempest-VolumesGetTest-1957083593 None] Acquiring lock "cinder-quobyte-e68ccec2-53a3-42e3-8c4d-350cf57a82eb" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:38:22 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6c8083a7-6393-4d4e-904b-9276e3cb670c tempest-VolumesGetTest-1957083593 None] Lock "cinder-quobyte-e68ccec2-53a3-42e3-8c4d-350cf57a82eb" acquired by "delete_volume" :: waited 0.021s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:38:22 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed573bbd-3471-4036-b6d8-22e55b802b07]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:38:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6c8083a7-6393-4d4e-904b-9276e3cb670c tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e68ccec2-53a3-42e3-8c4d-350cf57a82eb {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:22 devstack sudo[99563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e68ccec2-53a3-42e3-8c4d-350cf57a82eb Jun 04 06:38:22 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:23 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6c8083a7-6393-4d4e-904b-9276e3cb670c tempest-VolumesGetTest-1957083593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e68ccec2-53a3-42e3-8c4d-350cf57a82eb" returned: 0 in 0.795s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6c8083a7-6393-4d4e-904b-9276e3cb670c tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e68ccec2-53a3-42e3-8c4d-350cf57a82eb {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:23 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e68ccec2-53a3-42e3-8c4d-350cf57a82eb Jun 04 06:38:23 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:24 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6c8083a7-6393-4d4e-904b-9276e3cb670c tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e68ccec2-53a3-42e3-8c4d-350cf57a82eb" returned: 0 in 0.673s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:24 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6c8083a7-6393-4d4e-904b-9276e3cb670c tempest-VolumesGetTest-1957083593 None] Lock "cinder-quobyte-e68ccec2-53a3-42e3-8c4d-350cf57a82eb" released by "delete_volume" :: held 1.518s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:38:24 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-6c8083a7-6393-4d4e-904b-9276e3cb670c tempest-VolumesGetTest-1957083593 None] Created reservations ['4d1f5e75-bc5e-47be-b6ab-636bd4e80464', '492f4af5-7bde-4d50-bfa5-b752569769a1', '6d7bfad0-a8dc-4b35-ab4d-dba3de7e109a', 'e563569f-4d40-48c6-afbb-c6d67560bdbb'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:38:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-6c8083a7-6393-4d4e-904b-9276e3cb670c tempest-VolumesGetTest-1957083593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:38:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-6c8083a7-6393-4d4e-904b-9276e3cb670c tempest-VolumesGetTest-1957083593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:38:24 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-6c8083a7-6393-4d4e-904b-9276e3cb670c tempest-VolumesGetTest-1957083593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:38:24 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-6c8083a7-6393-4d4e-904b-9276e3cb670c tempest-VolumesGetTest-1957083593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:38:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-6c8083a7-6393-4d4e-904b-9276e3cb670c tempest-VolumesGetTest-1957083593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:38:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6c8083a7-6393-4d4e-904b-9276e3cb670c tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:24 devstack sudo[99574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:38:24 devstack sudo[99574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:25 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6f2c15b2-b64f-4ee0-9880-1f064c31fd2b tempest-VolumesGetTest-1957083593 None] Acquiring lock "cinder-9bf603fb-999d-4603-833c-4c9449a0be73-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:38:25 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6f2c15b2-b64f-4ee0-9880-1f064c31fd2b tempest-VolumesGetTest-1957083593 None] Lock "cinder-9bf603fb-999d-4603-833c-4c9449a0be73-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:38:25 devstack sudo[99574]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6c8083a7-6393-4d4e-904b-9276e3cb670c tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.651s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:25 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-6c8083a7-6393-4d4e-904b-9276e3cb670c tempest-VolumesGetTest-1957083593 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:38:25 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-6c8083a7-6393-4d4e-904b-9276e3cb670c tempest-VolumesGetTest-1957083593 None] Deleted volume successfully. Jun 04 06:38:25 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6f2c15b2-b64f-4ee0-9880-1f064c31fd2b tempest-VolumesGetTest-1957083593 None] Acquiring lock "cinder-quobyte-9bf603fb-999d-4603-833c-4c9449a0be73" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:38:25 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6c8083a7-6393-4d4e-904b-9276e3cb670c tempest-VolumesGetTest-1957083593 None] Lock "cinder-e68ccec2-53a3-42e3-8c4d-350cf57a82eb-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:38:25 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6f2c15b2-b64f-4ee0-9880-1f064c31fd2b tempest-VolumesGetTest-1957083593 None] Lock "cinder-quobyte-9bf603fb-999d-4603-833c-4c9449a0be73" acquired by "delete_volume" :: waited 0.025s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:38:25 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[339b4300-1e23-49e0-8f69-5bd4f93030cf]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:38:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6f2c15b2-b64f-4ee0-9880-1f064c31fd2b tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9bf603fb-999d-4603-833c-4c9449a0be73 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:25 devstack sudo[99577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9bf603fb-999d-4603-833c-4c9449a0be73 Jun 04 06:38:25 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:26 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6f2c15b2-b64f-4ee0-9880-1f064c31fd2b tempest-VolumesGetTest-1957083593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9bf603fb-999d-4603-833c-4c9449a0be73" returned: 0 in 0.987s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6f2c15b2-b64f-4ee0-9880-1f064c31fd2b tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9bf603fb-999d-4603-833c-4c9449a0be73 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:26 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9bf603fb-999d-4603-833c-4c9449a0be73 Jun 04 06:38:26 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:26 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6f2c15b2-b64f-4ee0-9880-1f064c31fd2b tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9bf603fb-999d-4603-833c-4c9449a0be73" returned: 0 in 0.724s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:26 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6f2c15b2-b64f-4ee0-9880-1f064c31fd2b tempest-VolumesGetTest-1957083593 None] Lock "cinder-quobyte-9bf603fb-999d-4603-833c-4c9449a0be73" released by "delete_volume" :: held 1.772s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:38:27 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-6f2c15b2-b64f-4ee0-9880-1f064c31fd2b tempest-VolumesGetTest-1957083593 None] Created reservations ['b993c954-6d92-4758-aa86-a8929a2040d5', '0263c124-0e6b-442e-9245-6ddafcd73d0e', 'fc6b7970-fcae-45e7-ab62-52e0d6d10275', 'a6b287e5-bb14-44c5-a2ba-c53afe54e945'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:38:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-6f2c15b2-b64f-4ee0-9880-1f064c31fd2b tempest-VolumesGetTest-1957083593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:38:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-6f2c15b2-b64f-4ee0-9880-1f064c31fd2b tempest-VolumesGetTest-1957083593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:38:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-6f2c15b2-b64f-4ee0-9880-1f064c31fd2b tempest-VolumesGetTest-1957083593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:38:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-6f2c15b2-b64f-4ee0-9880-1f064c31fd2b tempest-VolumesGetTest-1957083593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:38:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-6f2c15b2-b64f-4ee0-9880-1f064c31fd2b tempest-VolumesGetTest-1957083593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:38:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6f2c15b2-b64f-4ee0-9880-1f064c31fd2b tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:27 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:38:27 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-5b2ba335-821d-4316-925f-760c3b7b17d6 tempest-VolumesGetTest-1957083593 None] Acquiring lock "cinder-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:38:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-5b2ba335-821d-4316-925f-760c3b7b17d6 tempest-VolumesGetTest-1957083593 None] Lock "cinder-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:38:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-5b2ba335-821d-4316-925f-760c3b7b17d6 tempest-VolumesGetTest-1957083593 None] Acquiring lock "cinder-quobyte-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:38:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-5b2ba335-821d-4316-925f-760c3b7b17d6 tempest-VolumesGetTest-1957083593 None] Lock "cinder-quobyte-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29" acquired by "delete_volume" :: waited 0.023s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:38:27 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d47f116-e930-4a64-8103-75c8b6ee4703]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:38:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5b2ba335-821d-4316-925f-760c3b7b17d6 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:27 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29 Jun 04 06:38:27 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:28 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6f2c15b2-b64f-4ee0-9880-1f064c31fd2b tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.969s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:28 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-6f2c15b2-b64f-4ee0-9880-1f064c31fd2b tempest-VolumesGetTest-1957083593 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:38:28 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-6f2c15b2-b64f-4ee0-9880-1f064c31fd2b tempest-VolumesGetTest-1957083593 None] Deleted volume successfully. Jun 04 06:38:28 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6f2c15b2-b64f-4ee0-9880-1f064c31fd2b tempest-VolumesGetTest-1957083593 None] Lock "cinder-9bf603fb-999d-4603-833c-4c9449a0be73-delete_volume" released by "delete_volume" :: held 3.022s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:38:28 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5b2ba335-821d-4316-925f-760c3b7b17d6 tempest-VolumesGetTest-1957083593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29" returned: 0 in 1.113s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5b2ba335-821d-4316-925f-760c3b7b17d6 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:28 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29 Jun 04 06:38:28 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:29 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5b2ba335-821d-4316-925f-760c3b7b17d6 tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29" returned: 0 in 0.637s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:29 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-5b2ba335-821d-4316-925f-760c3b7b17d6 tempest-VolumesGetTest-1957083593 None] Lock "cinder-quobyte-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29" released by "delete_volume" :: held 1.833s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:38:29 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-5b2ba335-821d-4316-925f-760c3b7b17d6 tempest-VolumesGetTest-1957083593 None] Created reservations ['8cfcc3d7-a9ba-4b87-b2c8-f260ff635e40', '655fb0b3-5217-4362-b887-bf31b78147cb', '3399f3d2-1ade-428f-90c7-67fd12894bff', 'eb3c81ac-c499-476f-bf55-c57b14d90e78'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:38:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5b2ba335-821d-4316-925f-760c3b7b17d6 tempest-VolumesGetTest-1957083593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:38:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5b2ba335-821d-4316-925f-760c3b7b17d6 tempest-VolumesGetTest-1957083593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:38:29 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5b2ba335-821d-4316-925f-760c3b7b17d6 tempest-VolumesGetTest-1957083593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:38:29 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5b2ba335-821d-4316-925f-760c3b7b17d6 tempest-VolumesGetTest-1957083593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:38:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5b2ba335-821d-4316-925f-760c3b7b17d6 tempest-VolumesGetTest-1957083593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:38:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5b2ba335-821d-4316-925f-760c3b7b17d6 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:29 devstack sudo[99661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:38:29 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:30 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5b2ba335-821d-4316-925f-760c3b7b17d6 tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.696s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:30 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-5b2ba335-821d-4316-925f-760c3b7b17d6 tempest-VolumesGetTest-1957083593 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:38:30 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-5b2ba335-821d-4316-925f-760c3b7b17d6 tempest-VolumesGetTest-1957083593 None] Deleted volume successfully. Jun 04 06:38:30 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-5b2ba335-821d-4316-925f-760c3b7b17d6 tempest-VolumesGetTest-1957083593 None] Lock "cinder-d4dcb5bb-3781-4c4e-94f0-4a76fc13de29-delete_volume" released by "delete_volume" :: held 2.799s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:38:30 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:38:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Flow 'volume_create_manager' (cea9fdd1-ba1f-4858-b6f4-1ab39e3179b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:38:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5344fde0-d36b-454a-883a-de0d729717c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:38:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5344fde0-d36b-454a-883a-de0d729717c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-89595191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42438868-0b4e-4f70-8af7-148d5243b25a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ccd221c4edfc4f6e97b2c7d1828daef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:38:30Z,use_quota=True,user_id='47c74540fd7247e0ae8710e9573b8497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:38:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bafb4ea6-7c6c-4644-b93c-6d03d18bd9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:38:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bafb4ea6-7c6c-4644-b93c-6d03d18bd9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:38:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fff7c789-9dab-41f5-84ed-6446f8f67938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:38:30 devstack cinder-volume[86069]: DEBUG cinder.image.glance [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Creating Keystone auth plugin from conf {{(pid=86069) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 04 06:38:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fff7c789-9dab-41f5-84ed-6446f8f67938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '42438868-0b4e-4f70-8af7-148d5243b25a', 'volume_name': 'volume-42438868-0b4e-4f70-8af7-148d5243b25a', 'volume_size': 1, 'image_id': '356a113c-ac9f-4c32-896c-2ab17fc4b371', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/356a113c-ac9f-4c32-896c-2ab17fc4b371', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73b4c085134a4115abd513b2dd9d6c91', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '356a113c-ac9f-4c32-896c-2ab17fc4b371', 'created_at': datetime.datetime(2026, 6, 4, 4, 19, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 4, 19, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/356a113c-ac9f-4c32-896c-2ab17fc4b371/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:38:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (164c3896-ea39-4d97-b1dc-d21222d23757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:38:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (164c3896-ea39-4d97-b1dc-d21222d23757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:38:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95903de2-fb09-49be-b7c7-e5f9305d24e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:38:30 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Volume 42438868-0b4e-4f70-8af7-148d5243b25a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-42438868-0b4e-4f70-8af7-148d5243b25a', 'volume_size': 1, 'image_id': '356a113c-ac9f-4c32-896c-2ab17fc4b371', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/356a113c-ac9f-4c32-896c-2ab17fc4b371', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73b4c085134a4115abd513b2dd9d6c91', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '356a113c-ac9f-4c32-896c-2ab17fc4b371', 'created_at': datetime.datetime(2026, 6, 4, 4, 19, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 4, 19, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/356a113c-ac9f-4c32-896c-2ab17fc4b371/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 04 06:38:30 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Trying to clone 42438868-0b4e-4f70-8af7-148d5243b25a from image 356a113c-ac9f-4c32-896c-2ab17fc4b371 at location (None, [{'url': 'file:///opt/stack/data/glance/images/356a113c-ac9f-4c32-896c-2ab17fc4b371', 'metadata': {}}]). {{(pid=86069) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 04 06:38:31 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_hsr0_da6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86069) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 04 06:38:31 devstack cinder-volume[86069]: INFO cinder.image.image_utils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Image download 20.69 MB at 20.69 MB/s Jun 04 06:38:31 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[042a97ad-0011-4011-b34d-7e4313f74533]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:38:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_hsr0_da6devstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:31 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_hsr0_da6devstack@QuobyteHD Jun 04 06:38:31 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:31 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_hsr0_da6devstack@QuobyteHD" returned: 0 in 0.652s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:31 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Temporary image 356a113c-ac9f-4c32-896c-2ab17fc4b371 is fetched for user 47c74540fd7247e0ae8710e9573b8497. {{(pid=86069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 04 06:38:31 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb18e26-bc16-4302-ae81-dc1cdb63c887]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:38:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_hsr0_da6devstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:32 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_hsr0_da6devstack@QuobyteHD Jun 04 06:38:32 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:32 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_hsr0_da6devstack@QuobyteHD" returned: 0 in 0.642s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:38:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:38:32 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-89595191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42438868-0b4e-4f70-8af7-148d5243b25a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ccd221c4edfc4f6e97b2c7d1828daef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:38:30Z,use_quota=True,user_id='47c74540fd7247e0ae8710e9573b8497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:38:32 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Creating volume 42438868-0b4e-4f70-8af7-148d5243b25a {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:38:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:38:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:38:32 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:38:32 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:38:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:38:32 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:38:32 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:38:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-42438868-0b4e-4f70-8af7-148d5243b25a 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:32 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-42438868-0b4e-4f70-8af7-148d5243b25a 1073741824 Jun 04 06:38:32 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:33 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-42438868-0b4e-4f70-8af7-148d5243b25a 1073741824" returned: 0 in 0.884s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-42438868-0b4e-4f70-8af7-148d5243b25a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:33 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-42438868-0b4e-4f70-8af7-148d5243b25a Jun 04 06:38:33 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:33 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:38:33 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Flow 'volume_create_manager' (3dde898b-3586-41f2-9030-a65978834cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:38:33 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ade0ea82-bf17-481e-a41c-00ca4bc7f96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:38:33 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ade0ea82-bf17-481e-a41c-00ca4bc7f96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-160408369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=064e9a38-4058-43a2-9ad9-89da50eee78b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c50537949d045f7b4fa17374c655048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:38:34Z,use_quota=True,user_id='d05ca7cfc493483b92458fa2fc98accb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:38:33 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (164b0b01-608f-4731-8897-3889eb88e2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:38:33 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (164b0b01-608f-4731-8897-3889eb88e2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:38:33 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe32559-fdb8-4bb9-9853-d6edfb089276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:38:33 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe32559-fdb8-4bb9-9853-d6edfb089276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '064e9a38-4058-43a2-9ad9-89da50eee78b', 'volume_name': 'volume-064e9a38-4058-43a2-9ad9-89da50eee78b', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:38:33 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4882a0-2833-4d3a-84d3-4b8e99c90b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:38:33 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4882a0-2833-4d3a-84d3-4b8e99c90b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:38:33 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34bebe65-4f78-4489-b547-9e8c6b3e1dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:38:33 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Volume 064e9a38-4058-43a2-9ad9-89da50eee78b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-064e9a38-4058-43a2-9ad9-89da50eee78b', 'volume_size': 1} Jun 04 06:38:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:38:34 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-42438868-0b4e-4f70-8af7-148d5243b25a" returned: 0 in 0.650s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:38:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:38:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.367s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:38:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-160408369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=064e9a38-4058-43a2-9ad9-89da50eee78b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c50537949d045f7b4fa17374c655048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:38:34Z,use_quota=True,user_id='d05ca7cfc493483b92458fa2fc98accb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:38:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Creating volume 064e9a38-4058-43a2-9ad9-89da50eee78b {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:38:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:38:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:38:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:38:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:38:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:38:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:38:34 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:38:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-064e9a38-4058-43a2-9ad9-89da50eee78b 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:34 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-064e9a38-4058-43a2-9ad9-89da50eee78b 1073741824 Jun 04 06:38:34 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:34 devstack cinder-volume[86069]: DEBUG cinder.volume.volume_utils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Attempting download of 356a113c-ac9f-4c32-896c-2ab17fc4b371 ((None, [{'url': 'file:///opt/stack/data/glance/images/356a113c-ac9f-4c32-896c-2ab17fc4b371', 'metadata': {}}])) to volume 42438868-0b4e-4f70-8af7-148d5243b25a. {{(pid=86069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 04 06:38:34 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c25581-d516-480c-9f16-db3f8ee51631]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:38:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_356a113c-ac9f-4c32-896c-2ab17fc4b371_pz_a78qn {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:34 devstack sudo[99730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_356a113c-ac9f-4c32-896c-2ab17fc4b371_pz_a78qn Jun 04 06:38:34 devstack sudo[99730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:35 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-064e9a38-4058-43a2-9ad9-89da50eee78b 1073741824" returned: 0 in 0.816s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-064e9a38-4058-43a2-9ad9-89da50eee78b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:35 devstack sudo[99737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-064e9a38-4058-43a2-9ad9-89da50eee78b Jun 04 06:38:35 devstack sudo[99737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:35 devstack sudo[99730]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_356a113c-ac9f-4c32-896c-2ab17fc4b371_pz_a78qn" returned: 0 in 0.783s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_356a113c-ac9f-4c32-896c-2ab17fc4b371_pz_a78qn {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:35 devstack sudo[99739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_356a113c-ac9f-4c32-896c-2ab17fc4b371_pz_a78qn Jun 04 06:38:35 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:35 devstack sudo[99737]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-064e9a38-4058-43a2-9ad9-89da50eee78b" returned: 0 in 0.613s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:38:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:38:35 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34bebe65-4f78-4489-b547-9e8c6b3e1dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-064e9a38-4058-43a2-9ad9-89da50eee78b', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:38:35 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f0fa6a-24ad-4cf3-bff1-92a537df6715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:38:35 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Volume volume-064e9a38-4058-43a2-9ad9-89da50eee78b (064e9a38-4058-43a2-9ad9-89da50eee78b): created successfully Jun 04 06:38:35 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f0fa6a-24ad-4cf3-bff1-92a537df6715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:38:35 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Flow 'volume_create_manager' (3dde898b-3586-41f2-9030-a65978834cd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:38:35 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-e5fcd09f-a0a4-4981-be90-4a3e754be670 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Created volume successfully. Jun 04 06:38:35 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_356a113c-ac9f-4c32-896c-2ab17fc4b371_pz_a78qn" returned: 1 in 0.705s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_356a113c-ac9f-4c32-896c-2ab17fc4b371_pz_a78qn' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:38:35 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0c08b3-5bf6-4639-b99f-dc691095d73d]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:38:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_hsr0_da6devstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:35 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_hsr0_da6devstack@QuobyteHD Jun 04 06:38:35 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:36 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_hsr0_da6devstack@QuobyteHD" returned: 0 in 0.680s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:36 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] 356a113c-ac9f-4c32-896c-2ab17fc4b371 was qcow2, converting to raw {{(pid=86069) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 04 06:38:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_hsr0_da6devstack@QuobyteHD /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-42438868-0b4e-4f70-8af7-148d5243b25a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:36 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_hsr0_da6devstack@QuobyteHD /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-42438868-0b4e-4f70-8af7-148d5243b25a Jun 04 06:38:36 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:38 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_hsr0_da6devstack@QuobyteHD /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-42438868-0b4e-4f70-8af7-148d5243b25a" returned: 0 in 2.037s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:38 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_hsr0_da6devstack@QuobyteHD, size 112.00 MB, duration 2.04 sec, destination /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-42438868-0b4e-4f70-8af7-148d5243b25a {{(pid=86069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 06:38:38 devstack cinder-volume[86069]: INFO cinder.image.image_utils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Converted 112.00 MB image at 54.94 MB/s Jun 04 06:38:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-42438868-0b4e-4f70-8af7-148d5243b25a 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:38 devstack sudo[99759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-42438868-0b4e-4f70-8af7-148d5243b25a 1G Jun 04 06:38:38 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:39 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-42438868-0b4e-4f70-8af7-148d5243b25a 1G" returned: 0 in 0.726s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:39 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[249906be-d5af-450d-8514-2c6769e94867]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:38:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-42438868-0b4e-4f70-8af7-148d5243b25a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:39 devstack sudo[99764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-42438868-0b4e-4f70-8af7-148d5243b25a Jun 04 06:38:39 devstack sudo[99764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-42438868-0b4e-4f70-8af7-148d5243b25a" returned: 0 in 0.715s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:40 devstack sudo[99764]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-42438868-0b4e-4f70-8af7-148d5243b25a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-f555cbc0-0a13-457c-beca-c6b6aa23cc39 req-5a89f1ee-22b0-41e5-a554-0ae866fbe873 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:38:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-f555cbc0-0a13-457c-beca-c6b6aa23cc39 req-5a89f1ee-22b0-41e5-a554-0ae866fbe873 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:38:40 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b426fed-4f27-4882-8cbd-52f04705e3b9]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:38:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-f555cbc0-0a13-457c-beca-c6b6aa23cc39 req-5a89f1ee-22b0-41e5-a554-0ae866fbe873 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-064e9a38-4058-43a2-9ad9-89da50eee78b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:40 devstack sudo[99778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-42438868-0b4e-4f70-8af7-148d5243b25a Jun 04 06:38:40 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:40 devstack sudo[99779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-064e9a38-4058-43a2-9ad9-89da50eee78b Jun 04 06:38:40 devstack sudo[99779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:40 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-42438868-0b4e-4f70-8af7-148d5243b25a" returned: 1 in 0.729s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-42438868-0b4e-4f70-8af7-148d5243b25a' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:38:40 devstack cinder-volume[86069]: DEBUG cinder.volume.volume_utils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Downloaded image 356a113c-ac9f-4c32-896c-2ab17fc4b371 ((None, [{'url': 'file:///opt/stack/data/glance/images/356a113c-ac9f-4c32-896c-2ab17fc4b371', 'metadata': {}}])) to volume 42438868-0b4e-4f70-8af7-148d5243b25a successfully. {{(pid=86069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 04 06:38:40 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Temporary image 356a113c-ac9f-4c32-896c-2ab17fc4b371 for user 47c74540fd7247e0ae8710e9573b8497 is deleted. {{(pid=86069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 04 06:38:40 devstack cinder-volume[86069]: DEBUG cinder.volume.volume_utils [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Marking volume 42438868-0b4e-4f70-8af7-148d5243b25a as bootable. {{(pid=86069) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 04 06:38:40 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Copying metadata from image 356a113c-ac9f-4c32-896c-2ab17fc4b371 to 42438868-0b4e-4f70-8af7-148d5243b25a. {{(pid=86069) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 04 06:38:40 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Creating volume glance metadata for volume 42438868-0b4e-4f70-8af7-148d5243b25a backed by image 356a113c-ac9f-4c32-896c-2ab17fc4b371 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '356a113c-ac9f-4c32-896c-2ab17fc4b371', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86069) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 04 06:38:40 devstack sudo[99779]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-f555cbc0-0a13-457c-beca-c6b6aa23cc39 req-5a89f1ee-22b0-41e5-a554-0ae866fbe873 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-064e9a38-4058-43a2-9ad9-89da50eee78b" returned: 0 in 0.734s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-f555cbc0-0a13-457c-beca-c6b6aa23cc39 req-5a89f1ee-22b0-41e5-a554-0ae866fbe873 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.753s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:38:40 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95903de2-fb09-49be-b7c7-e5f9305d24e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42438868-0b4e-4f70-8af7-148d5243b25a', 'volume_size': 1, 'image_id': '356a113c-ac9f-4c32-896c-2ab17fc4b371', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/356a113c-ac9f-4c32-896c-2ab17fc4b371', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73b4c085134a4115abd513b2dd9d6c91', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '356a113c-ac9f-4c32-896c-2ab17fc4b371', 'created_at': datetime.datetime(2026, 6, 4, 4, 19, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 4, 19, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/356a113c-ac9f-4c32-896c-2ab17fc4b371/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:38:40 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61e3c252-b842-4e7b-aa34-15bbe4ac9041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:38:40 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Volume volume-42438868-0b4e-4f70-8af7-148d5243b25a (42438868-0b4e-4f70-8af7-148d5243b25a): created successfully Jun 04 06:38:40 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61e3c252-b842-4e7b-aa34-15bbe4ac9041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:38:40 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Flow 'volume_create_manager' (cea9fdd1-ba1f-4858-b6f4-1ab39e3179b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:38:40 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-f555cbc0-0a13-457c-beca-c6b6aa23cc39 req-5a89f1ee-22b0-41e5-a554-0ae866fbe873 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574', 'name': 'volume-064e9a38-4058-43a2-9ad9-89da50eee78b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9fb4a7b1-2eb5-4e33-b285-2a9735ff3b4e', 'enforce_multipath': True} {{(pid=86069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 06:38:40 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-c96d165b-9853-46e4-9da2-c992386a8960 tempest-VolumesGetTest-1957083593 None] Created volume successfully. Jun 04 06:38:41 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-f555cbc0-0a13-457c-beca-c6b6aa23cc39 req-5a89f1ee-22b0-41e5-a554-0ae866fbe873 tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] attachment_update completed successfully. Jun 04 06:38:41 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:38:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] Flow 'volume_create_manager' (a7492659-1b15-481a-82c3-ae84dc345dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:38:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c874e24-449e-4339-acdb-5a87bf23d93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:38:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c874e24-449e-4339-acdb-5a87bf23d93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:38:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-238959936',display_name='tempest-VolumesGetTest-Volume-1048755602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59da9152-c508-46fc-b8d6-1f6ff09a4be1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccd221c4edfc4f6e97b2c7d1828daef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:38:42Z,use_quota=True,user_id='47c74540fd7247e0ae8710e9573b8497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:38:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d28751-9898-4113-af3c-002bb52f94fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:38:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d28751-9898-4113-af3c-002bb52f94fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:38:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273b8ce9-3477-479b-b58c-cc116b493abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:38:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273b8ce9-3477-479b-b58c-cc116b493abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59da9152-c508-46fc-b8d6-1f6ff09a4be1', 'volume_name': 'volume-59da9152-c508-46fc-b8d6-1f6ff09a4be1', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:38:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9894bdf-4336-454a-bc4f-682806d2ae84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:38:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9894bdf-4336-454a-bc4f-682806d2ae84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:38:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce84835c-881c-414c-aa63-43593f33d02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:38:41 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] Volume 59da9152-c508-46fc-b8d6-1f6ff09a4be1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59da9152-c508-46fc-b8d6-1f6ff09a4be1', 'volume_size': 1} Jun 04 06:38:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:38:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:38:41 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:38:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-238959936',display_name='tempest-VolumesGetTest-Volume-1048755602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59da9152-c508-46fc-b8d6-1f6ff09a4be1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccd221c4edfc4f6e97b2c7d1828daef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:38:42Z,use_quota=True,user_id='47c74540fd7247e0ae8710e9573b8497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:38:41 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] Creating volume 59da9152-c508-46fc-b8d6-1f6ff09a4be1 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:38:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:38:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:38:41 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:38:41 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:38:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:38:41 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:38:41 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:38:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-59da9152-c508-46fc-b8d6-1f6ff09a4be1 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:42 devstack sudo[100170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-59da9152-c508-46fc-b8d6-1f6ff09a4be1 1073741824 Jun 04 06:38:42 devstack sudo[100170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:42 devstack sudo[100170]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-59da9152-c508-46fc-b8d6-1f6ff09a4be1 1073741824" returned: 0 in 0.853s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-59da9152-c508-46fc-b8d6-1f6ff09a4be1 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:42 devstack sudo[100176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-59da9152-c508-46fc-b8d6-1f6ff09a4be1 Jun 04 06:38:42 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:43 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-59da9152-c508-46fc-b8d6-1f6ff09a4be1" returned: 0 in 0.591s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:43 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:38:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:38:43 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce84835c-881c-414c-aa63-43593f33d02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59da9152-c508-46fc-b8d6-1f6ff09a4be1', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:38:43 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f9c0ded-1436-48c7-a50c-353a0b50effd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:38:43 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] Volume volume-59da9152-c508-46fc-b8d6-1f6ff09a4be1 (59da9152-c508-46fc-b8d6-1f6ff09a4be1): created successfully Jun 04 06:38:43 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f9c0ded-1436-48c7-a50c-353a0b50effd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:38:43 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] Flow 'volume_create_manager' (a7492659-1b15-481a-82c3-ae84dc345dfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:38:43 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-42101c5e-e3ce-48f0-8260-7b57e15e1d34 tempest-VolumesGetTest-1957083593 None] Created volume successfully. Jun 04 06:38:44 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d26d83af-13a9-4cfe-94dd-d3e5d587c6b1 tempest-VolumesGetTest-1957083593 None] Acquiring lock "cinder-59da9152-c508-46fc-b8d6-1f6ff09a4be1-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:38:44 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d26d83af-13a9-4cfe-94dd-d3e5d587c6b1 tempest-VolumesGetTest-1957083593 None] Lock "cinder-59da9152-c508-46fc-b8d6-1f6ff09a4be1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:38:44 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d26d83af-13a9-4cfe-94dd-d3e5d587c6b1 tempest-VolumesGetTest-1957083593 None] Acquiring lock "cinder-quobyte-59da9152-c508-46fc-b8d6-1f6ff09a4be1" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:38:44 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d26d83af-13a9-4cfe-94dd-d3e5d587c6b1 tempest-VolumesGetTest-1957083593 None] Lock "cinder-quobyte-59da9152-c508-46fc-b8d6-1f6ff09a4be1" acquired by "delete_volume" :: waited 0.019s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:38:44 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d7112a-60ba-4c8e-94b7-332696796bb8]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:38:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d26d83af-13a9-4cfe-94dd-d3e5d587c6b1 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-59da9152-c508-46fc-b8d6-1f6ff09a4be1 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:44 devstack sudo[100179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-59da9152-c508-46fc-b8d6-1f6ff09a4be1 Jun 04 06:38:44 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:44 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d26d83af-13a9-4cfe-94dd-d3e5d587c6b1 tempest-VolumesGetTest-1957083593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-59da9152-c508-46fc-b8d6-1f6ff09a4be1" returned: 0 in 0.712s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d26d83af-13a9-4cfe-94dd-d3e5d587c6b1 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-59da9152-c508-46fc-b8d6-1f6ff09a4be1 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:44 devstack sudo[100184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-59da9152-c508-46fc-b8d6-1f6ff09a4be1 Jun 04 06:38:44 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:45 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d26d83af-13a9-4cfe-94dd-d3e5d587c6b1 tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-59da9152-c508-46fc-b8d6-1f6ff09a4be1" returned: 0 in 0.665s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:45 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d26d83af-13a9-4cfe-94dd-d3e5d587c6b1 tempest-VolumesGetTest-1957083593 None] Lock "cinder-quobyte-59da9152-c508-46fc-b8d6-1f6ff09a4be1" released by "delete_volume" :: held 1.418s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:38:45 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-d26d83af-13a9-4cfe-94dd-d3e5d587c6b1 tempest-VolumesGetTest-1957083593 None] Created reservations ['5f07f440-52f3-4b3f-87a3-2a314e834359', '17153cd3-eb99-4464-b532-9a8f5a81c030', '9c30aef0-911c-416c-8acf-2c1c0b912316', 'c1b21d0f-da40-4d82-8c73-a5a69a7617e1'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:38:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d26d83af-13a9-4cfe-94dd-d3e5d587c6b1 tempest-VolumesGetTest-1957083593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:38:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d26d83af-13a9-4cfe-94dd-d3e5d587c6b1 tempest-VolumesGetTest-1957083593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:38:45 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d26d83af-13a9-4cfe-94dd-d3e5d587c6b1 tempest-VolumesGetTest-1957083593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:38:45 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d26d83af-13a9-4cfe-94dd-d3e5d587c6b1 tempest-VolumesGetTest-1957083593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:38:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d26d83af-13a9-4cfe-94dd-d3e5d587c6b1 tempest-VolumesGetTest-1957083593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:38:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d26d83af-13a9-4cfe-94dd-d3e5d587c6b1 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:45 devstack sudo[100187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:38:45 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:46 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d26d83af-13a9-4cfe-94dd-d3e5d587c6b1 tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.620s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:46 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-d26d83af-13a9-4cfe-94dd-d3e5d587c6b1 tempest-VolumesGetTest-1957083593 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:38:46 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-d26d83af-13a9-4cfe-94dd-d3e5d587c6b1 tempest-VolumesGetTest-1957083593 None] Deleted volume successfully. Jun 04 06:38:46 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d26d83af-13a9-4cfe-94dd-d3e5d587c6b1 tempest-VolumesGetTest-1957083593 None] Lock "cinder-59da9152-c508-46fc-b8d6-1f6ff09a4be1-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:38:46 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1423384a-8727-4197-8afc-e6c3ff7a2993 tempest-VolumesGetTest-1957083593 None] Acquiring lock "cinder-42438868-0b4e-4f70-8af7-148d5243b25a-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:38:46 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1423384a-8727-4197-8afc-e6c3ff7a2993 tempest-VolumesGetTest-1957083593 None] Lock "cinder-42438868-0b4e-4f70-8af7-148d5243b25a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:38:46 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1423384a-8727-4197-8afc-e6c3ff7a2993 tempest-VolumesGetTest-1957083593 None] Acquiring lock "cinder-quobyte-42438868-0b4e-4f70-8af7-148d5243b25a" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:38:46 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1423384a-8727-4197-8afc-e6c3ff7a2993 tempest-VolumesGetTest-1957083593 None] Lock "cinder-quobyte-42438868-0b4e-4f70-8af7-148d5243b25a" acquired by "delete_volume" :: waited 0.017s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:38:46 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09fc935-590f-49b8-ab8a-593b7f8bbf7a]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:38:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1423384a-8727-4197-8afc-e6c3ff7a2993 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-42438868-0b4e-4f70-8af7-148d5243b25a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:46 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-42438868-0b4e-4f70-8af7-148d5243b25a Jun 04 06:38:46 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:47 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-f35940d5-eff3-4c46-9631-9e41dd17703d req-6d17997d-c6a5-43f9-99b3-f7fcbac4a22c tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Terminate volume connection completed successfully. Jun 04 06:38:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-f35940d5-eff3-4c46-9631-9e41dd17703d req-6d17997d-c6a5-43f9-99b3-f7fcbac4a22c tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Deleting attachment 9fb4a7b1-2eb5-4e33-b285-2a9735ff3b4e. {{(pid=86069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 06:38:47 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1423384a-8727-4197-8afc-e6c3ff7a2993 tempest-VolumesGetTest-1957083593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-42438868-0b4e-4f70-8af7-148d5243b25a" returned: 0 in 0.765s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1423384a-8727-4197-8afc-e6c3ff7a2993 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-42438868-0b4e-4f70-8af7-148d5243b25a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:47 devstack sudo[100223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-42438868-0b4e-4f70-8af7-148d5243b25a Jun 04 06:38:47 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:48 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1423384a-8727-4197-8afc-e6c3ff7a2993 tempest-VolumesGetTest-1957083593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-42438868-0b4e-4f70-8af7-148d5243b25a" returned: 1 in 0.730s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1423384a-8727-4197-8afc-e6c3ff7a2993 tempest-VolumesGetTest-1957083593 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-42438868-0b4e-4f70-8af7-148d5243b25a' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:38:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1423384a-8727-4197-8afc-e6c3ff7a2993 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-42438868-0b4e-4f70-8af7-148d5243b25a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:48 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-42438868-0b4e-4f70-8af7-148d5243b25a Jun 04 06:38:48 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:48 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1423384a-8727-4197-8afc-e6c3ff7a2993 tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-42438868-0b4e-4f70-8af7-148d5243b25a" returned: 0 in 0.632s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:48 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1423384a-8727-4197-8afc-e6c3ff7a2993 tempest-VolumesGetTest-1957083593 None] Lock "cinder-quobyte-42438868-0b4e-4f70-8af7-148d5243b25a" released by "delete_volume" :: held 2.203s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:38:48 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-1423384a-8727-4197-8afc-e6c3ff7a2993 tempest-VolumesGetTest-1957083593 None] Created reservations ['a86a71e8-0a89-4644-b443-0b15e127223d', '5ad1cd31-9534-4504-8445-1f15504f9b90', '14713dfa-0778-423f-9f23-bb2b1670d465', '38485737-403a-4eb8-98ab-06bdbb2b0e50'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:38:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-1423384a-8727-4197-8afc-e6c3ff7a2993 tempest-VolumesGetTest-1957083593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:38:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-1423384a-8727-4197-8afc-e6c3ff7a2993 tempest-VolumesGetTest-1957083593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:38:48 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-1423384a-8727-4197-8afc-e6c3ff7a2993 tempest-VolumesGetTest-1957083593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:38:48 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-1423384a-8727-4197-8afc-e6c3ff7a2993 tempest-VolumesGetTest-1957083593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:38:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-1423384a-8727-4197-8afc-e6c3ff7a2993 tempest-VolumesGetTest-1957083593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:38:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1423384a-8727-4197-8afc-e6c3ff7a2993 tempest-VolumesGetTest-1957083593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:48 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:38:48 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:49 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0538a936-57d2-403e-bc20-a454126c792b tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Acquiring lock "cinder-064e9a38-4058-43a2-9ad9-89da50eee78b-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:38:49 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0538a936-57d2-403e-bc20-a454126c792b tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Lock "cinder-064e9a38-4058-43a2-9ad9-89da50eee78b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:38:49 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0538a936-57d2-403e-bc20-a454126c792b tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Acquiring lock "cinder-quobyte-064e9a38-4058-43a2-9ad9-89da50eee78b" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:38:49 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0538a936-57d2-403e-bc20-a454126c792b tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Lock "cinder-quobyte-064e9a38-4058-43a2-9ad9-89da50eee78b" acquired by "delete_volume" :: waited 0.017s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:38:49 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f658813-4c25-4e73-8828-68c5a264965b]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:38:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0538a936-57d2-403e-bc20-a454126c792b tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-064e9a38-4058-43a2-9ad9-89da50eee78b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:49 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1423384a-8727-4197-8afc-e6c3ff7a2993 tempest-VolumesGetTest-1957083593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.636s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:49 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-1423384a-8727-4197-8afc-e6c3ff7a2993 tempest-VolumesGetTest-1957083593 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:38:49 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-1423384a-8727-4197-8afc-e6c3ff7a2993 tempest-VolumesGetTest-1957083593 None] Deleted volume successfully. Jun 04 06:38:49 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1423384a-8727-4197-8afc-e6c3ff7a2993 tempest-VolumesGetTest-1957083593 None] Lock "cinder-42438868-0b4e-4f70-8af7-148d5243b25a-delete_volume" released by "delete_volume" :: held 3.119s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:38:49 devstack sudo[100236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-064e9a38-4058-43a2-9ad9-89da50eee78b Jun 04 06:38:49 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:50 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0538a936-57d2-403e-bc20-a454126c792b tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-064e9a38-4058-43a2-9ad9-89da50eee78b" returned: 0 in 1.131s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0538a936-57d2-403e-bc20-a454126c792b tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-064e9a38-4058-43a2-9ad9-89da50eee78b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:50 devstack sudo[100278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-064e9a38-4058-43a2-9ad9-89da50eee78b Jun 04 06:38:50 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:51 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0538a936-57d2-403e-bc20-a454126c792b tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-064e9a38-4058-43a2-9ad9-89da50eee78b" returned: 0 in 0.683s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:51 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0538a936-57d2-403e-bc20-a454126c792b tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Lock "cinder-quobyte-064e9a38-4058-43a2-9ad9-89da50eee78b" released by "delete_volume" :: held 1.860s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:38:51 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-0538a936-57d2-403e-bc20-a454126c792b tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Created reservations ['3f8f2705-e9ad-4b44-8c38-02c5c05340a9', 'afdfe53d-183b-4230-819b-f044688ca6eb', 'd681f0b1-0382-41ad-8b3c-ff926e70afcd', '491a3828-1f71-4de7-9b6c-eb7cb26e0d9e'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:38:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0538a936-57d2-403e-bc20-a454126c792b tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:38:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0538a936-57d2-403e-bc20-a454126c792b tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:38:51 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0538a936-57d2-403e-bc20-a454126c792b tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:38:51 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0538a936-57d2-403e-bc20-a454126c792b tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:38:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0538a936-57d2-403e-bc20-a454126c792b tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:38:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0538a936-57d2-403e-bc20-a454126c792b tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:51 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:38:51 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:52 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0538a936-57d2-403e-bc20-a454126c792b tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.956s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:52 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-0538a936-57d2-403e-bc20-a454126c792b tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:38:52 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-0538a936-57d2-403e-bc20-a454126c792b tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Deleted volume successfully. Jun 04 06:38:52 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0538a936-57d2-403e-bc20-a454126c792b tempest-TestServerVolumeAttachScenarioOldVersion-2065734698 None] Lock "cinder-064e9a38-4058-43a2-9ad9-89da50eee78b-delete_volume" released by "delete_volume" :: held 3.076s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:38:57 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-33e8a075-0454-4163-ad20-567375085577 tempest-AttachVolumeShelveTestJSON-2104168720 None] Acquiring lock "cinder-b96625e2-6104-430a-b8c2-3da6e012e443-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:38:57 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-33e8a075-0454-4163-ad20-567375085577 tempest-AttachVolumeShelveTestJSON-2104168720 None] Lock "cinder-b96625e2-6104-430a-b8c2-3da6e012e443-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:38:57 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-33e8a075-0454-4163-ad20-567375085577 tempest-AttachVolumeShelveTestJSON-2104168720 None] Acquiring lock "cinder-quobyte-b96625e2-6104-430a-b8c2-3da6e012e443" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:38:57 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-33e8a075-0454-4163-ad20-567375085577 tempest-AttachVolumeShelveTestJSON-2104168720 None] Lock "cinder-quobyte-b96625e2-6104-430a-b8c2-3da6e012e443" acquired by "delete_volume" :: waited 0.014s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:38:57 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[732096c7-5e17-4ff6-acfc-8ec6ba48a2ae]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:38:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-33e8a075-0454-4163-ad20-567375085577 tempest-AttachVolumeShelveTestJSON-2104168720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b96625e2-6104-430a-b8c2-3da6e012e443 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:57 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b96625e2-6104-430a-b8c2-3da6e012e443 Jun 04 06:38:57 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:58 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-33e8a075-0454-4163-ad20-567375085577 tempest-AttachVolumeShelveTestJSON-2104168720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b96625e2-6104-430a-b8c2-3da6e012e443" returned: 0 in 0.746s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-33e8a075-0454-4163-ad20-567375085577 tempest-AttachVolumeShelveTestJSON-2104168720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b96625e2-6104-430a-b8c2-3da6e012e443 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:58 devstack sudo[100334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b96625e2-6104-430a-b8c2-3da6e012e443 Jun 04 06:38:58 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:38:59 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root Jun 04 06:38:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-33e8a075-0454-4163-ad20-567375085577 tempest-AttachVolumeShelveTestJSON-2104168720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b96625e2-6104-430a-b8c2-3da6e012e443" returned: 0 in 0.874s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:38:59 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-33e8a075-0454-4163-ad20-567375085577 tempest-AttachVolumeShelveTestJSON-2104168720 None] Lock "cinder-quobyte-b96625e2-6104-430a-b8c2-3da6e012e443" released by "delete_volume" :: held 1.664s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:38:59 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-33e8a075-0454-4163-ad20-567375085577 tempest-AttachVolumeShelveTestJSON-2104168720 None] Created reservations ['db2ae9ca-160f-42d8-9341-7cba3037daa6', '0bfcab0a-92d9-4753-95fc-bb06a9d7b9f8', 'f64ed1a8-3ae4-4900-8891-bb6865af064f', '6e411bf3-f278-4c9b-bc2e-fdb88d087807'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:38:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-33e8a075-0454-4163-ad20-567375085577 tempest-AttachVolumeShelveTestJSON-2104168720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:38:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-33e8a075-0454-4163-ad20-567375085577 tempest-AttachVolumeShelveTestJSON-2104168720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:38:59 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-33e8a075-0454-4163-ad20-567375085577 tempest-AttachVolumeShelveTestJSON-2104168720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:38:59 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-33e8a075-0454-4163-ad20-567375085577 tempest-AttachVolumeShelveTestJSON-2104168720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:38:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-33e8a075-0454-4163-ad20-567375085577 tempest-AttachVolumeShelveTestJSON-2104168720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:38:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-33e8a075-0454-4163-ad20-567375085577 tempest-AttachVolumeShelveTestJSON-2104168720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:38:59 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:38:59 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:00 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ab815dd8-d81a-412b-987f-276f359a4c8c tempest-AttachVolumeShelveTestJSON-2104168720 None] Acquiring lock "cinder-04e84166-152f-49ef-b6fd-fcc3d8f00326-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:39:00 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ab815dd8-d81a-412b-987f-276f359a4c8c tempest-AttachVolumeShelveTestJSON-2104168720 None] Lock "cinder-04e84166-152f-49ef-b6fd-fcc3d8f00326-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:39:00 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ab815dd8-d81a-412b-987f-276f359a4c8c tempest-AttachVolumeShelveTestJSON-2104168720 None] Acquiring lock "cinder-quobyte-04e84166-152f-49ef-b6fd-fcc3d8f00326" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:39:00 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ab815dd8-d81a-412b-987f-276f359a4c8c tempest-AttachVolumeShelveTestJSON-2104168720 None] Lock "cinder-quobyte-04e84166-152f-49ef-b6fd-fcc3d8f00326" acquired by "delete_volume" :: waited 0.039s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:39:00 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[b581b92f-c4d3-4c1f-9e6e-e7a3a4e38f54]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:39:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ab815dd8-d81a-412b-987f-276f359a4c8c tempest-AttachVolumeShelveTestJSON-2104168720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-04e84166-152f-49ef-b6fd-fcc3d8f00326 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:00 devstack sudo[100339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-04e84166-152f-49ef-b6fd-fcc3d8f00326 Jun 04 06:39:00 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:00 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-33e8a075-0454-4163-ad20-567375085577 tempest-AttachVolumeShelveTestJSON-2104168720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.976s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:00 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-33e8a075-0454-4163-ad20-567375085577 tempest-AttachVolumeShelveTestJSON-2104168720 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:39:00 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-33e8a075-0454-4163-ad20-567375085577 tempest-AttachVolumeShelveTestJSON-2104168720 None] Deleted volume successfully. Jun 04 06:39:00 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-33e8a075-0454-4163-ad20-567375085577 tempest-AttachVolumeShelveTestJSON-2104168720 None] Lock "cinder-b96625e2-6104-430a-b8c2-3da6e012e443-delete_volume" released by "delete_volume" :: held 2.929s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:39:01 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ab815dd8-d81a-412b-987f-276f359a4c8c tempest-AttachVolumeShelveTestJSON-2104168720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-04e84166-152f-49ef-b6fd-fcc3d8f00326" returned: 0 in 1.081s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ab815dd8-d81a-412b-987f-276f359a4c8c tempest-AttachVolumeShelveTestJSON-2104168720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-04e84166-152f-49ef-b6fd-fcc3d8f00326 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:01 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-04e84166-152f-49ef-b6fd-fcc3d8f00326 Jun 04 06:39:01 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:01 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ab815dd8-d81a-412b-987f-276f359a4c8c tempest-AttachVolumeShelveTestJSON-2104168720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-04e84166-152f-49ef-b6fd-fcc3d8f00326" returned: 0 in 0.663s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:01 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ab815dd8-d81a-412b-987f-276f359a4c8c tempest-AttachVolumeShelveTestJSON-2104168720 None] Lock "cinder-quobyte-04e84166-152f-49ef-b6fd-fcc3d8f00326" released by "delete_volume" :: held 1.827s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:39:02 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-ab815dd8-d81a-412b-987f-276f359a4c8c tempest-AttachVolumeShelveTestJSON-2104168720 None] Created reservations ['1f2c4f38-a9ca-4fbd-b795-eb58c7c87065', 'b2a2b23d-ac1c-4fb9-b870-e02beacabfe6', '12b74308-71d6-44b3-9543-78ff8175e32f', 'f74b6071-d53b-4f04-97ee-2318906b269f'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:39:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ab815dd8-d81a-412b-987f-276f359a4c8c tempest-AttachVolumeShelveTestJSON-2104168720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:39:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ab815dd8-d81a-412b-987f-276f359a4c8c tempest-AttachVolumeShelveTestJSON-2104168720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:39:02 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ab815dd8-d81a-412b-987f-276f359a4c8c tempest-AttachVolumeShelveTestJSON-2104168720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:39:02 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ab815dd8-d81a-412b-987f-276f359a4c8c tempest-AttachVolumeShelveTestJSON-2104168720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:39:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ab815dd8-d81a-412b-987f-276f359a4c8c tempest-AttachVolumeShelveTestJSON-2104168720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:39:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ab815dd8-d81a-412b-987f-276f359a4c8c tempest-AttachVolumeShelveTestJSON-2104168720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:02 devstack sudo[100349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:39:02 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:02 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ab815dd8-d81a-412b-987f-276f359a4c8c tempest-AttachVolumeShelveTestJSON-2104168720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.782s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:02 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-ab815dd8-d81a-412b-987f-276f359a4c8c tempest-AttachVolumeShelveTestJSON-2104168720 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:39:02 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-ab815dd8-d81a-412b-987f-276f359a4c8c tempest-AttachVolumeShelveTestJSON-2104168720 None] Deleted volume successfully. Jun 04 06:39:02 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ab815dd8-d81a-412b-987f-276f359a4c8c tempest-AttachVolumeShelveTestJSON-2104168720 None] Lock "cinder-04e84166-152f-49ef-b6fd-fcc3d8f00326-delete_volume" released by "delete_volume" :: held 2.937s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:39:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:39:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:39:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:39:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:39:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:39:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:39:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:11 devstack sudo[100357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:39:11 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:12 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.965s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:12 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:39:12 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager._thread_info {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:39:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread count: 28 {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 06:39:12 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread info: [<_MainThread(MainThread, started 131797370544256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 06:39:12 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:UPDATE=80,cinder:SELECT=63,cinder:DELETE=7,cinder:INSERT=24 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:39:12 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:UPDATE=85,cinder:SELECT=63,cinder:INSERT=26,cinder:DELETE=6 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:39:16 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:39:16 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] Flow 'volume_create_manager' (eaec78e3-30a8-422f-91fb-8bcfbc4e7748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:39:16 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db80409-49db-49c0-9137-071eff2fddfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:16 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db80409-49db-49c0-9137-071eff2fddfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bbe13ba-2336-4069-957d-933b90a5c139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='659423db84a44681aca7299a1ea49539',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:39:16Z,use_quota=True,user_id='bf6c6fd7fed74f3aa878a1e8bbe1ca57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:16 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ca674a-1523-48ea-8000-ffb959fff322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:16 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ca674a-1523-48ea-8000-ffb959fff322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:16 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2387ff8e-800d-4cb3-a29c-9d7686e516ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:16 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2387ff8e-800d-4cb3-a29c-9d7686e516ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bbe13ba-2336-4069-957d-933b90a5c139', 'volume_name': 'volume-5bbe13ba-2336-4069-957d-933b90a5c139', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:16 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7829d131-78e6-4176-9dd6-ad86347ec70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:16 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7829d131-78e6-4176-9dd6-ad86347ec70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:16 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c744ae-5b42-4e66-bad1-3042757c00d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:16 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] Volume 5bbe13ba-2336-4069-957d-933b90a5c139: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bbe13ba-2336-4069-957d-933b90a5c139', 'volume_size': 1} Jun 04 06:39:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:39:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:39:16 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bbe13ba-2336-4069-957d-933b90a5c139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='659423db84a44681aca7299a1ea49539',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:39:16Z,use_quota=True,user_id='bf6c6fd7fed74f3aa878a1e8bbe1ca57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:39:16 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] Creating volume 5bbe13ba-2336-4069-957d-933b90a5c139 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:39:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:39:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:39:16 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:39:16 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:39:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:39:16 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:39:16 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:39:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bbe13ba-2336-4069-957d-933b90a5c139 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:16 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bbe13ba-2336-4069-957d-933b90a5c139 1073741824 Jun 04 06:39:16 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:16 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-6cbe7387-6ab2-4fdc-9fd4-d44eafc2152b tempest-BackendsCapabilitiesAdminTestsJSON-1986278260 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579765319824, 'free_capacity_gb': 1775.7579765319824, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86069) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4831}} Jun 04 06:39:17 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c2012ef3-c3b2-4a00-ae4c-21b86b406310 tempest-BackendsCapabilitiesAdminTestsJSON-1986278260 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579765319824, 'free_capacity_gb': 1775.7579765319824, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86069) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4831}} Jun 04 06:39:17 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bbe13ba-2336-4069-957d-933b90a5c139 1073741824" returned: 0 in 1.024s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bbe13ba-2336-4069-957d-933b90a5c139 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:17 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bbe13ba-2336-4069-957d-933b90a5c139 Jun 04 06:39:17 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:17 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bbe13ba-2336-4069-957d-933b90a5c139" returned: 0 in 0.685s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:17 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] <== create_volume: return (1758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:39:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:39:17 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c744ae-5b42-4e66-bad1-3042757c00d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bbe13ba-2336-4069-957d-933b90a5c139', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:17 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cfd863a-b86e-4415-ad92-968cb5af3672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:17 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] Volume volume-5bbe13ba-2336-4069-957d-933b90a5c139 (5bbe13ba-2336-4069-957d-933b90a5c139): created successfully Jun 04 06:39:17 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cfd863a-b86e-4415-ad92-968cb5af3672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:17 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] Flow 'volume_create_manager' (eaec78e3-30a8-422f-91fb-8bcfbc4e7748) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:39:17 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-7129ff01-14dd-46a4-a5e4-4b0b1eef8edf tempest-CinderUnicodeTest-990369008 None] Created volume successfully. Jun 04 06:39:18 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:39:18 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] Flow 'volume_create_manager' (dd0331d4-a822-4dfa-9c2c-2508510a01bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:39:18 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b314529-73bc-4125-9d88-59eaab5505e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:18 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b314529-73bc-4125-9d88-59eaab5505e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:39:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-358947267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=269e96a7-f765-4c63-a6a7-e9553249d747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='659423db84a44681aca7299a1ea49539',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:39:19Z,use_quota=True,user_id='bf6c6fd7fed74f3aa878a1e8bbe1ca57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:18 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef26b8e-b84a-4975-8d2e-6aace57b8b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:18 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef26b8e-b84a-4975-8d2e-6aace57b8b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:18 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (681a4124-86b5-49cd-ac71-e3820418939b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:18 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (681a4124-86b5-49cd-ac71-e3820418939b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '269e96a7-f765-4c63-a6a7-e9553249d747', 'volume_name': 'volume-269e96a7-f765-4c63-a6a7-e9553249d747', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:18 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf82d67-4f31-4057-8185-fddef64ff872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:18 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf82d67-4f31-4057-8185-fddef64ff872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:18 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a25189e-fff0-4132-b67c-6035b6b256cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:18 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] Volume 269e96a7-f765-4c63-a6a7-e9553249d747: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-269e96a7-f765-4c63-a6a7-e9553249d747', 'volume_size': 1} Jun 04 06:39:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:39:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:39:18 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:39:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-358947267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=269e96a7-f765-4c63-a6a7-e9553249d747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='659423db84a44681aca7299a1ea49539',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:39:19Z,use_quota=True,user_id='bf6c6fd7fed74f3aa878a1e8bbe1ca57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:39:18 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] Creating volume 269e96a7-f765-4c63-a6a7-e9553249d747 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:39:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:39:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:39:18 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:39:18 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:39:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:39:18 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:39:18 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:39:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:18 devstack sudo[100373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747 1073741824 Jun 04 06:39:18 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:19 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747 1073741824" returned: 0 in 0.967s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:19 devstack sudo[100379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747 Jun 04 06:39:19 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:20 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747" returned: 0 in 0.689s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:20 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] <== create_volume: return (1719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:39:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:39:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a25189e-fff0-4132-b67c-6035b6b256cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-269e96a7-f765-4c63-a6a7-e9553249d747', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ed7f41-0b84-4b98-9bff-9607bfa4fbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:20 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] Volume volume-269e96a7-f765-4c63-a6a7-e9553249d747 (269e96a7-f765-4c63-a6a7-e9553249d747): created successfully Jun 04 06:39:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ed7f41-0b84-4b98-9bff-9607bfa4fbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:20 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] Flow 'volume_create_manager' (dd0331d4-a822-4dfa-9c2c-2508510a01bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:39:20 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-efe4dc10-0d34-4b57-a668-4cebac8db823 tempest-CinderUnicodeTest-990369008 None] Created volume successfully. Jun 04 06:39:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-fc826924-94f5-42b1-993e-cf86b08145f9 tempest-CinderUnicodeTest-990369008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:39:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-fc826924-94f5-42b1-993e-cf86b08145f9 tempest-CinderUnicodeTest-990369008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:39:21 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-fc826924-94f5-42b1-993e-cf86b08145f9 tempest-CinderUnicodeTest-990369008 None] Creating offline snapshot 79945571-5d7c-4398-a515-98480c026e82 of volume 269e96a7-f765-4c63-a6a7-e9553249d747 {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:39:21 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1bddcf-f126-49c8-93d1-92a19d92fc50]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:39:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fc826924-94f5-42b1-993e-cf86b08145f9 tempest-CinderUnicodeTest-990369008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:21 devstack sudo[100382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747 Jun 04 06:39:21 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:22 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fc826924-94f5-42b1-993e-cf86b08145f9 tempest-CinderUnicodeTest-990369008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747" returned: 0 in 0.821s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fc826924-94f5-42b1-993e-cf86b08145f9 tempest-CinderUnicodeTest-990369008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747.79945571-5d7c-4398-a515-98480c026e82 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:22 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747.79945571-5d7c-4398-a515-98480c026e82 1G Jun 04 06:39:22 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:22 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fc826924-94f5-42b1-993e-cf86b08145f9 tempest-CinderUnicodeTest-990369008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747.79945571-5d7c-4398-a515-98480c026e82 1G" returned: 0 in 0.956s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fc826924-94f5-42b1-993e-cf86b08145f9 tempest-CinderUnicodeTest-990369008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-269e96a7-f765-4c63-a6a7-e9553249d747 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747.79945571-5d7c-4398-a515-98480c026e82 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:23 devstack sudo[100393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-269e96a7-f765-4c63-a6a7-e9553249d747 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747.79945571-5d7c-4398-a515-98480c026e82 Jun 04 06:39:23 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:23 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fc826924-94f5-42b1-993e-cf86b08145f9 tempest-CinderUnicodeTest-990369008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-269e96a7-f765-4c63-a6a7-e9553249d747 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747.79945571-5d7c-4398-a515-98480c026e82" returned: 0 in 0.777s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:23 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-fc826924-94f5-42b1-993e-cf86b08145f9 tempest-CinderUnicodeTest-990369008 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747.79945571-5d7c-4398-a515-98480c026e82 is being set with open permissions: ugo+rw Jun 04 06:39:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fc826924-94f5-42b1-993e-cf86b08145f9 tempest-CinderUnicodeTest-990369008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747.79945571-5d7c-4398-a515-98480c026e82 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:23 devstack sudo[100398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747.79945571-5d7c-4398-a515-98480c026e82 Jun 04 06:39:23 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:24 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fc826924-94f5-42b1-993e-cf86b08145f9 tempest-CinderUnicodeTest-990369008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747.79945571-5d7c-4398-a515-98480c026e82" returned: 0 in 0.696s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fc826924-94f5-42b1-993e-cf86b08145f9 tempest-CinderUnicodeTest-990369008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:24 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747.info Jun 04 06:39:24 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:25 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fc826924-94f5-42b1-993e-cf86b08145f9 tempest-CinderUnicodeTest-990369008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747.info" returned: 0 in 0.745s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:25 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-fc826924-94f5-42b1-993e-cf86b08145f9 tempest-CinderUnicodeTest-990369008 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747.info is being set with open permissions: ugo+rw Jun 04 06:39:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fc826924-94f5-42b1-993e-cf86b08145f9 tempest-CinderUnicodeTest-990369008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:25 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747.info Jun 04 06:39:25 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:25 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:39:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] Flow 'volume_create_manager' (7570a3bb-7135-451c-95f1-72084f0943c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:39:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76709ed5-5c98-42cd-8af4-3a15ca74fa5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76709ed5-5c98-42cd-8af4-3a15ca74fa5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-177198143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e16e316b-22b2-4496-b9c2-73e3ff02d3ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04c4e26e02804efc94cc42ed22acb3bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:39:26Z,use_quota=True,user_id='4fb9fef48fcf4e8a853d3637ba18a404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9426070c-50af-4b8e-8c39-c4c4940a902d),volume_type_id=9426070c-50af-4b8e-8c39-c4c4940a902d)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b235d256-a286-4f17-9d23-c419c64d4986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b235d256-a286-4f17-9d23-c419c64d4986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f405dfa-abb9-4392-a0b1-0bf7ec725c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f405dfa-abb9-4392-a0b1-0bf7ec725c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e16e316b-22b2-4496-b9c2-73e3ff02d3ae', 'volume_name': 'volume-e16e316b-22b2-4496-b9c2-73e3ff02d3ae', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c1b43b1-7733-4577-84f3-0a0ca8c77bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c1b43b1-7733-4577-84f3-0a0ca8c77bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa2a75e-5137-4a0b-b39a-57451f27478c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:25 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] Volume e16e316b-22b2-4496-b9c2-73e3ff02d3ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e16e316b-22b2-4496-b9c2-73e3ff02d3ae', 'volume_size': 1} Jun 04 06:39:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:39:26 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fc826924-94f5-42b1-993e-cf86b08145f9 tempest-CinderUnicodeTest-990369008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747.info" returned: 0 in 0.892s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-fc826924-94f5-42b1-993e-cf86b08145f9 tempest-CinderUnicodeTest-990369008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.057s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:39:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.345s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:39:26 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-177198143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e16e316b-22b2-4496-b9c2-73e3ff02d3ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04c4e26e02804efc94cc42ed22acb3bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:39:26Z,use_quota=True,user_id='4fb9fef48fcf4e8a853d3637ba18a404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9426070c-50af-4b8e-8c39-c4c4940a902d),volume_type_id=9426070c-50af-4b8e-8c39-c4c4940a902d)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:39:26 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] Creating volume e16e316b-22b2-4496-b9c2-73e3ff02d3ae {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:39:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:39:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:39:26 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:39:26 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:39:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:39:26 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:39:26 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:39:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e16e316b-22b2-4496-b9c2-73e3ff02d3ae 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:26 devstack sudo[100407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e16e316b-22b2-4496-b9c2-73e3ff02d3ae 1073741824 Jun 04 06:39:26 devstack sudo[100407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:26 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-fc826924-94f5-42b1-993e-cf86b08145f9 tempest-CinderUnicodeTest-990369008 None] Create snapshot completed successfully Jun 04 06:39:26 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:39:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] Flow 'volume_create_manager' (18f0c6a1-b03c-4428-9a53-47f188b9baef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:39:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb9299a-8ebe-4536-b617-1c16a05e4b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb9299a-8ebe-4536-b617-1c16a05e4b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1305294155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9aebd60-4028-4a2b-80b0-ac0072329627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04c4e26e02804efc94cc42ed22acb3bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:39:26Z,use_quota=True,user_id='4fb9fef48fcf4e8a853d3637ba18a404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c386b9-dbd1-4b31-adda-a770880934c2),volume_type_id=c8c386b9-dbd1-4b31-adda-a770880934c2)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53793b4c-80ae-4286-ab48-e037c943a569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53793b4c-80ae-4286-ab48-e037c943a569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1514a23-23ae-40d7-816d-adc2dce92ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1514a23-23ae-40d7-816d-adc2dce92ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9aebd60-4028-4a2b-80b0-ac0072329627', 'volume_name': 'volume-c9aebd60-4028-4a2b-80b0-ac0072329627', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d30adf-fe35-4103-bfb4-b83fab73b09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d30adf-fe35-4103-bfb4-b83fab73b09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (925a51e2-a4c3-4d46-b419-a71dbdada7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:26 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] Volume c9aebd60-4028-4a2b-80b0-ac0072329627: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9aebd60-4028-4a2b-80b0-ac0072329627', 'volume_size': 1} Jun 04 06:39:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:39:27 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:39:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Flow 'volume_create_manager' (fc9c7b0e-f6a7-497f-b170-9eec038bc29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:39:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d021af-3e7f-42cf-a367-86b6dff11611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d021af-3e7f-42cf-a367-86b6dff11611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1178170174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d96b2fa-7747-48d3-9976-dd1c30d264a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04c4e26e02804efc94cc42ed22acb3bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:39:27Z,use_quota=True,user_id='4fb9fef48fcf4e8a853d3637ba18a404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49366b0d-b8f5-42bd-ade9-1d8816e8d01d),volume_type_id=49366b0d-b8f5-42bd-ade9-1d8816e8d01d)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6848a7e-2189-4534-b640-90d7e4052f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6848a7e-2189-4534-b640-90d7e4052f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1775f08c-b26e-426d-8851-72dcc36a092b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:27 devstack cinder-volume[86069]: DEBUG cinder.image.glance [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Creating Keystone auth plugin from conf {{(pid=86069) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 04 06:39:27 devstack sudo[100407]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e16e316b-22b2-4496-b9c2-73e3ff02d3ae 1073741824" returned: 0 in 1.033s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e16e316b-22b2-4496-b9c2-73e3ff02d3ae {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:27 devstack sudo[100414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e16e316b-22b2-4496-b9c2-73e3ff02d3ae Jun 04 06:39:27 devstack sudo[100414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1775f08c-b26e-426d-8851-72dcc36a092b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7d96b2fa-7747-48d3-9976-dd1c30d264a4', 'volume_name': 'volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4', 'volume_size': 1, 'image_id': 'aa4c2c97-c1fa-430a-9aa8-37e48783e95f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa4c2c97-c1fa-430a-9aa8-37e48783e95f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1226933186', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '04c4e26e02804efc94cc42ed22acb3bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa4c2c97-c1fa-430a-9aa8-37e48783e95f', 'created_at': datetime.datetime(2026, 6, 4, 4, 39, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 4, 39, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa4c2c97-c1fa-430a-9aa8-37e48783e95f/file', 'properties': {}}, 'image_service': }' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a5e1cb-8a45-4d3f-89eb-68c46ee76dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a5e1cb-8a45-4d3f-89eb-68c46ee76dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e1ff8b4-3698-4ac3-87ee-8c6d1f6ec8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:27 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Volume 7d96b2fa-7747-48d3-9976-dd1c30d264a4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4', 'volume_size': 1, 'image_id': 'aa4c2c97-c1fa-430a-9aa8-37e48783e95f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa4c2c97-c1fa-430a-9aa8-37e48783e95f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1226933186', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '04c4e26e02804efc94cc42ed22acb3bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa4c2c97-c1fa-430a-9aa8-37e48783e95f', 'created_at': datetime.datetime(2026, 6, 4, 4, 39, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 4, 39, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa4c2c97-c1fa-430a-9aa8-37e48783e95f/file', 'properties': {}}, 'image_service': } Jun 04 06:39:27 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Trying to clone 7d96b2fa-7747-48d3-9976-dd1c30d264a4 from image aa4c2c97-c1fa-430a-9aa8-37e48783e95f at location (None, [{'url': 'file:///opt/stack/data/glance/images/aa4c2c97-c1fa-430a-9aa8-37e48783e95f', 'metadata': {}}]). {{(pid=86069) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 04 06:39:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-48fb2c74-a9f5-4364-8c18-ed708f499689 tempest-CinderUnicodeTest-990369008 None] Acquiring lock "cinder-79945571-5d7c-4398-a515-98480c026e82-delete_snapshot" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:39:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-48fb2c74-a9f5-4364-8c18-ed708f499689 tempest-CinderUnicodeTest-990369008 None] Lock "cinder-79945571-5d7c-4398-a515-98480c026e82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:39:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-48fb2c74-a9f5-4364-8c18-ed708f499689 tempest-CinderUnicodeTest-990369008 None] Acquiring lock "cinder-quobyte-269e96a7-f765-4c63-a6a7-e9553249d747" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:39:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-48fb2c74-a9f5-4364-8c18-ed708f499689 tempest-CinderUnicodeTest-990369008 None] Lock "cinder-quobyte-269e96a7-f765-4c63-a6a7-e9553249d747" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:39:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-48fb2c74-a9f5-4364-8c18-ed708f499689 tempest-CinderUnicodeTest-990369008 None] Acquiring lock "cinder-quobyte-79945571-5d7c-4398-a515-98480c026e82" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:39:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-48fb2c74-a9f5-4364-8c18-ed708f499689 tempest-CinderUnicodeTest-990369008 None] Lock "cinder-quobyte-79945571-5d7c-4398-a515-98480c026e82" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:39:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-48fb2c74-a9f5-4364-8c18-ed708f499689 tempest-CinderUnicodeTest-990369008 None] Deleting offline snapshot 79945571-5d7c-4398-a515-98480c026e82 of volume 269e96a7-f765-4c63-a6a7-e9553249d747 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:39:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-48fb2c74-a9f5-4364-8c18-ed708f499689 tempest-CinderUnicodeTest-990369008 None] snapshot_file for this snap is: volume-269e96a7-f765-4c63-a6a7-e9553249d747.79945571-5d7c-4398-a515-98480c026e82 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:39:27 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e42d997-c020-4276-b73f-7d9d6a7484c3]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:39:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-48fb2c74-a9f5-4364-8c18-ed708f499689 tempest-CinderUnicodeTest-990369008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747.79945571-5d7c-4398-a515-98480c026e82 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:27 devstack sudo[100416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747.79945571-5d7c-4398-a515-98480c026e82 Jun 04 06:39:27 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:28 devstack sudo[100414]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e16e316b-22b2-4496-b9c2-73e3ff02d3ae" returned: 0 in 0.948s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:28 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] <== create_volume: return (2061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:39:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.065s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:39:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.808s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:39:28 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1305294155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9aebd60-4028-4a2b-80b0-ac0072329627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04c4e26e02804efc94cc42ed22acb3bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:39:26Z,use_quota=True,user_id='4fb9fef48fcf4e8a853d3637ba18a404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c386b9-dbd1-4b31-adda-a770880934c2),volume_type_id=c8c386b9-dbd1-4b31-adda-a770880934c2)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:39:28 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] Creating volume c9aebd60-4028-4a2b-80b0-ac0072329627 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:39:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:39:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:39:28 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:39:28 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:39:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:39:28 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:39:28 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:39:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9aebd60-4028-4a2b-80b0-ac0072329627 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:28 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9aebd60-4028-4a2b-80b0-ac0072329627 1073741824 Jun 04 06:39:28 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa2a75e-5137-4a0b-b39a-57451f27478c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e16e316b-22b2-4496-b9c2-73e3ff02d3ae', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62884d8d-8d25-4aaf-af72-e2d84e363a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:28 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] Volume volume-e16e316b-22b2-4496-b9c2-73e3ff02d3ae (e16e316b-22b2-4496-b9c2-73e3ff02d3ae): created successfully Jun 04 06:39:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62884d8d-8d25-4aaf-af72-e2d84e363a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] Flow 'volume_create_manager' (7570a3bb-7135-451c-95f1-72084f0943c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:39:28 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-9b4fdc7c-ea6a-455a-8f9c-d81c5485436c tempest-TestInstancesWithCinderVolumes-1114328522 None] Created volume successfully. Jun 04 06:39:28 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-48fb2c74-a9f5-4364-8c18-ed708f499689 tempest-CinderUnicodeTest-990369008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747.79945571-5d7c-4398-a515-98480c026e82" returned: 0 in 0.950s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:28 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-48fb2c74-a9f5-4364-8c18-ed708f499689 tempest-CinderUnicodeTest-990369008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-269e96a7-f765-4c63-a6a7-e9553249d747(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:39:28 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[b192198e-c0d0-4795-bb4b-b0d367c09154]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:39:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-48fb2c74-a9f5-4364-8c18-ed708f499689 tempest-CinderUnicodeTest-990369008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:28 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747 Jun 04 06:39:28 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:29 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9aebd60-4028-4a2b-80b0-ac0072329627 1073741824" returned: 0 in 1.015s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9aebd60-4028-4a2b-80b0-ac0072329627 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:29 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9aebd60-4028-4a2b-80b0-ac0072329627 Jun 04 06:39:29 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:29 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-48fb2c74-a9f5-4364-8c18-ed708f499689 tempest-CinderUnicodeTest-990369008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747" returned: 0 in 0.891s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-48fb2c74-a9f5-4364-8c18-ed708f499689 tempest-CinderUnicodeTest-990369008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747.79945571-5d7c-4398-a515-98480c026e82 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:29 devstack sudo[100435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747.79945571-5d7c-4398-a515-98480c026e82 Jun 04 06:39:29 devstack sudo[100435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:30 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9aebd60-4028-4a2b-80b0-ac0072329627" returned: 0 in 0.886s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] <== create_volume: return (1968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:39:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.971s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:39:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (925a51e2-a4c3-4d46-b419-a71dbdada7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9aebd60-4028-4a2b-80b0-ac0072329627', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26936bfe-782b-4497-bba1-ba842724b2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:30 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] Volume volume-c9aebd60-4028-4a2b-80b0-ac0072329627 (c9aebd60-4028-4a2b-80b0-ac0072329627): created successfully Jun 04 06:39:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26936bfe-782b-4497-bba1-ba842724b2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] Flow 'volume_create_manager' (18f0c6a1-b03c-4428-9a53-47f188b9baef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:39:30 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-62dccdda-48e1-4f69-8bce-74bf36519e41 tempest-TestInstancesWithCinderVolumes-1114328522 None] Created volume successfully. Jun 04 06:39:30 devstack sudo[100435]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-48fb2c74-a9f5-4364-8c18-ed708f499689 tempest-CinderUnicodeTest-990369008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747.79945571-5d7c-4398-a515-98480c026e82" returned: 0 in 0.983s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-48fb2c74-a9f5-4364-8c18-ed708f499689 tempest-CinderUnicodeTest-990369008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747.79945571-5d7c-4398-a515-98480c026e82 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:30 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747.79945571-5d7c-4398-a515-98480c026e82 Jun 04 06:39:30 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:31 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-48fb2c74-a9f5-4364-8c18-ed708f499689 tempest-CinderUnicodeTest-990369008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747.79945571-5d7c-4398-a515-98480c026e82" returned: 0 in 0.773s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:31 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-48fb2c74-a9f5-4364-8c18-ed708f499689 tempest-CinderUnicodeTest-990369008 None] Lock "cinder-quobyte-79945571-5d7c-4398-a515-98480c026e82" released by "_delete_snapshot" :: held 3.758s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:39:31 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-48fb2c74-a9f5-4364-8c18-ed708f499689 tempest-CinderUnicodeTest-990369008 None] Lock "cinder-quobyte-269e96a7-f765-4c63-a6a7-e9553249d747" released by "delete_snapshot" :: held 3.788s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:39:31 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-48fb2c74-a9f5-4364-8c18-ed708f499689 tempest-CinderUnicodeTest-990369008 None] Created reservations ['e67de897-ff88-49b4-a0d0-a9b8e5b280ed', '3c40f70f-d56c-4e25-a65f-1ada7e871ae8', '80494b7a-505f-439d-8dda-6ba01a91c425', '0814446f-4cc9-4fd3-9394-b64c3e6a56f9'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:39:31 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-48fb2c74-a9f5-4364-8c18-ed708f499689 tempest-CinderUnicodeTest-990369008 None] Delete snapshot completed successfully. Jun 04 06:39:31 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-48fb2c74-a9f5-4364-8c18-ed708f499689 tempest-CinderUnicodeTest-990369008 None] Lock "cinder-79945571-5d7c-4398-a515-98480c026e82-delete_snapshot" released by "delete_snapshot" :: held 3.998s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:39:31 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1ef75f3b-6ae0-4e58-8fc7-943423e8645c tempest-CinderUnicodeTest-990369008 None] Acquiring lock "cinder-269e96a7-f765-4c63-a6a7-e9553249d747-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:39:31 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1ef75f3b-6ae0-4e58-8fc7-943423e8645c tempest-CinderUnicodeTest-990369008 None] Lock "cinder-269e96a7-f765-4c63-a6a7-e9553249d747-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:39:31 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1ef75f3b-6ae0-4e58-8fc7-943423e8645c tempest-CinderUnicodeTest-990369008 None] Acquiring lock "cinder-quobyte-269e96a7-f765-4c63-a6a7-e9553249d747" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:39:31 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1ef75f3b-6ae0-4e58-8fc7-943423e8645c tempest-CinderUnicodeTest-990369008 None] Lock "cinder-quobyte-269e96a7-f765-4c63-a6a7-e9553249d747" acquired by "delete_volume" :: waited 0.024s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:39:32 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab7d064-f811-4f23-a76a-ddd49a35ad16]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:39:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1ef75f3b-6ae0-4e58-8fc7-943423e8645c tempest-CinderUnicodeTest-990369008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:32 devstack sudo[100481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747 Jun 04 06:39:32 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:32 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_aa4c2c97-c1fa-430a-9aa8-37e48783e95f_wnctjtuldevstack@QuobyteHD, size 20.69 MB, duration 4.83 sec {{(pid=86069) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 04 06:39:32 devstack cinder-volume[86069]: INFO cinder.image.image_utils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Image download 20.69 MB at 4.28 MB/s Jun 04 06:39:32 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[a768b9fc-e96e-4150-82d8-ad4d9c9b83e8]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:39:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa4c2c97-c1fa-430a-9aa8-37e48783e95f_wnctjtuldevstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:32 devstack sudo[100483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa4c2c97-c1fa-430a-9aa8-37e48783e95f_wnctjtuldevstack@QuobyteHD Jun 04 06:39:32 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:32 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1ef75f3b-6ae0-4e58-8fc7-943423e8645c tempest-CinderUnicodeTest-990369008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747" returned: 0 in 0.894s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1ef75f3b-6ae0-4e58-8fc7-943423e8645c tempest-CinderUnicodeTest-990369008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:32 devstack sudo[100488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747 Jun 04 06:39:32 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:33 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa4c2c97-c1fa-430a-9aa8-37e48783e95f_wnctjtuldevstack@QuobyteHD" returned: 0 in 0.790s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:33 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Temporary image aa4c2c97-c1fa-430a-9aa8-37e48783e95f is fetched for user 4fb9fef48fcf4e8a853d3637ba18a404. {{(pid=86069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 04 06:39:33 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf43a45-29b0-4e05-8ee3-920f29ccd0e9]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:39:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa4c2c97-c1fa-430a-9aa8-37e48783e95f_wnctjtuldevstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:33 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa4c2c97-c1fa-430a-9aa8-37e48783e95f_wnctjtuldevstack@QuobyteHD Jun 04 06:39:33 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:33 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1ef75f3b-6ae0-4e58-8fc7-943423e8645c tempest-CinderUnicodeTest-990369008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-269e96a7-f765-4c63-a6a7-e9553249d747" returned: 0 in 0.686s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1ef75f3b-6ae0-4e58-8fc7-943423e8645c tempest-CinderUnicodeTest-990369008 None] Lock "cinder-quobyte-269e96a7-f765-4c63-a6a7-e9553249d747" released by "delete_volume" :: held 1.674s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:39:33 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-1ef75f3b-6ae0-4e58-8fc7-943423e8645c tempest-CinderUnicodeTest-990369008 None] Created reservations ['46354761-4db5-4d8b-8956-780d9b40569e', '24a678cb-d6e3-4ae7-a275-81a9dc69d540', 'd43353f2-bad0-4335-b8b0-e2601ba38647', 'bc0eb839-bc08-4c58-bdfb-76fa697ade2d'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:39:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-1ef75f3b-6ae0-4e58-8fc7-943423e8645c tempest-CinderUnicodeTest-990369008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:39:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-1ef75f3b-6ae0-4e58-8fc7-943423e8645c tempest-CinderUnicodeTest-990369008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:39:33 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-1ef75f3b-6ae0-4e58-8fc7-943423e8645c tempest-CinderUnicodeTest-990369008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:39:33 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-1ef75f3b-6ae0-4e58-8fc7-943423e8645c tempest-CinderUnicodeTest-990369008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:39:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-1ef75f3b-6ae0-4e58-8fc7-943423e8645c tempest-CinderUnicodeTest-990369008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:39:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1ef75f3b-6ae0-4e58-8fc7-943423e8645c tempest-CinderUnicodeTest-990369008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:33 devstack sudo[100496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:39:33 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:34 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa4c2c97-c1fa-430a-9aa8-37e48783e95f_wnctjtuldevstack@QuobyteHD" returned: 0 in 0.729s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:39:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:39:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1178170174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d96b2fa-7747-48d3-9976-dd1c30d264a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04c4e26e02804efc94cc42ed22acb3bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:39:27Z,use_quota=True,user_id='4fb9fef48fcf4e8a853d3637ba18a404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49366b0d-b8f5-42bd-ade9-1d8816e8d01d),volume_type_id=49366b0d-b8f5-42bd-ade9-1d8816e8d01d)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:39:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Creating volume 7d96b2fa-7747-48d3-9976-dd1c30d264a4 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:39:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:39:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:39:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:39:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:39:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:39:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:39:34 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:39:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:34 devstack sudo[100501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4 1073741824 Jun 04 06:39:34 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6da6f957-2a6d-4b78-be6e-3a26f70a518f tempest-CinderUnicodeTest-990369008 None] Acquiring lock "cinder-5bbe13ba-2336-4069-957d-933b90a5c139-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:39:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6da6f957-2a6d-4b78-be6e-3a26f70a518f tempest-CinderUnicodeTest-990369008 None] Lock "cinder-5bbe13ba-2336-4069-957d-933b90a5c139-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:39:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6da6f957-2a6d-4b78-be6e-3a26f70a518f tempest-CinderUnicodeTest-990369008 None] Acquiring lock "cinder-quobyte-5bbe13ba-2336-4069-957d-933b90a5c139" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:39:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6da6f957-2a6d-4b78-be6e-3a26f70a518f tempest-CinderUnicodeTest-990369008 None] Lock "cinder-quobyte-5bbe13ba-2336-4069-957d-933b90a5c139" acquired by "delete_volume" :: waited 0.025s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:39:34 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c3265b-3943-4ed7-8339-035ffbe61e59]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:39:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6da6f957-2a6d-4b78-be6e-3a26f70a518f tempest-CinderUnicodeTest-990369008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bbe13ba-2336-4069-957d-933b90a5c139 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:34 devstack sudo[100503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bbe13ba-2336-4069-957d-933b90a5c139 Jun 04 06:39:34 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:34 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1ef75f3b-6ae0-4e58-8fc7-943423e8645c tempest-CinderUnicodeTest-990369008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.784s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:34 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-1ef75f3b-6ae0-4e58-8fc7-943423e8645c tempest-CinderUnicodeTest-990369008 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:39:34 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-1ef75f3b-6ae0-4e58-8fc7-943423e8645c tempest-CinderUnicodeTest-990369008 None] Deleted volume successfully. Jun 04 06:39:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1ef75f3b-6ae0-4e58-8fc7-943423e8645c tempest-CinderUnicodeTest-990369008 None] Lock "cinder-269e96a7-f765-4c63-a6a7-e9553249d747-delete_volume" released by "delete_volume" :: held 2.733s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:39:35 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:35 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6da6f957-2a6d-4b78-be6e-3a26f70a518f tempest-CinderUnicodeTest-990369008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bbe13ba-2336-4069-957d-933b90a5c139" returned: 0 in 0.862s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6da6f957-2a6d-4b78-be6e-3a26f70a518f tempest-CinderUnicodeTest-990369008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bbe13ba-2336-4069-957d-933b90a5c139 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4 1073741824" returned: 0 in 1.092s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:35 devstack sudo[100518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bbe13ba-2336-4069-957d-933b90a5c139 Jun 04 06:39:35 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:35 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4 Jun 04 06:39:35 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:35 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6da6f957-2a6d-4b78-be6e-3a26f70a518f tempest-CinderUnicodeTest-990369008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5bbe13ba-2336-4069-957d-933b90a5c139" returned: 0 in 0.664s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:35 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6da6f957-2a6d-4b78-be6e-3a26f70a518f tempest-CinderUnicodeTest-990369008 None] Lock "cinder-quobyte-5bbe13ba-2336-4069-957d-933b90a5c139" released by "delete_volume" :: held 1.595s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:39:35 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4" returned: 0 in 0.672s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:39:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.832s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:39:35 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-6da6f957-2a6d-4b78-be6e-3a26f70a518f tempest-CinderUnicodeTest-990369008 None] Created reservations ['ea1fb0b6-0b4f-46fd-8c4a-1ad91feafc17', '955f495a-e02d-46a3-8fb5-d57c56d6087a', '469efa80-86b5-4cb5-a6b6-737583cb8fbf', 'b04ddc6e-4167-4502-8c46-a7c04f39413b'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:39:35 devstack cinder-volume[86069]: DEBUG cinder.volume.volume_utils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Attempting download of aa4c2c97-c1fa-430a-9aa8-37e48783e95f ((None, [{'url': 'file:///opt/stack/data/glance/images/aa4c2c97-c1fa-430a-9aa8-37e48783e95f', 'metadata': {}}])) to volume 7d96b2fa-7747-48d3-9976-dd1c30d264a4. {{(pid=86069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 04 06:39:35 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[c969a116-3090-4779-9d7b-1c06d00af920]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:39:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa4c2c97-c1fa-430a-9aa8-37e48783e95f_ksv_nzft {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-6da6f957-2a6d-4b78-be6e-3a26f70a518f tempest-CinderUnicodeTest-990369008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:39:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-6da6f957-2a6d-4b78-be6e-3a26f70a518f tempest-CinderUnicodeTest-990369008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:39:36 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-6da6f957-2a6d-4b78-be6e-3a26f70a518f tempest-CinderUnicodeTest-990369008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:39:36 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-6da6f957-2a6d-4b78-be6e-3a26f70a518f tempest-CinderUnicodeTest-990369008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:39:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-6da6f957-2a6d-4b78-be6e-3a26f70a518f tempest-CinderUnicodeTest-990369008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:39:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6da6f957-2a6d-4b78-be6e-3a26f70a518f tempest-CinderUnicodeTest-990369008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:36 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:39:36 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:36 devstack sudo[100524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa4c2c97-c1fa-430a-9aa8-37e48783e95f_ksv_nzft Jun 04 06:39:36 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:36 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa4c2c97-c1fa-430a-9aa8-37e48783e95f_ksv_nzft" returned: 0 in 0.804s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa4c2c97-c1fa-430a-9aa8-37e48783e95f_ksv_nzft {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:36 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6da6f957-2a6d-4b78-be6e-3a26f70a518f tempest-CinderUnicodeTest-990369008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.829s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:36 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-6da6f957-2a6d-4b78-be6e-3a26f70a518f tempest-CinderUnicodeTest-990369008 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:39:36 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-6da6f957-2a6d-4b78-be6e-3a26f70a518f tempest-CinderUnicodeTest-990369008 None] Deleted volume successfully. Jun 04 06:39:36 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6da6f957-2a6d-4b78-be6e-3a26f70a518f tempest-CinderUnicodeTest-990369008 None] Lock "cinder-5bbe13ba-2336-4069-957d-933b90a5c139-delete_volume" released by "delete_volume" :: held 2.710s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:39:36 devstack sudo[100531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa4c2c97-c1fa-430a-9aa8-37e48783e95f_ksv_nzft Jun 04 06:39:36 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:37 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:39:37 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Flow 'volume_create_manager' (e1489d5c-4d64-481e-bdf1-0af11095bcf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:39:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909378cc-41fd-4515-b4f0-a0bc0ad166b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa4c2c97-c1fa-430a-9aa8-37e48783e95f_ksv_nzft" returned: 1 in 0.860s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa4c2c97-c1fa-430a-9aa8-37e48783e95f_ksv_nzft' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:39:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909378cc-41fd-4515-b4f0-a0bc0ad166b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1401226281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f75dece-92d2-4ca8-8a59-0136279b7c9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82fcae418bda4e2e8ed2933d03ea0658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:39:38Z,use_quota=True,user_id='4ecb754f66f8484aac2a61a1f0856bcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2719bae-58fb-45c5-be72-eafd3f57dfcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2719bae-58fb-45c5-be72-eafd3f57dfcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5b56463-cbd0-4f25-8269-412b9ce85a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5b56463-cbd0-4f25-8269-412b9ce85a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f75dece-92d2-4ca8-8a59-0136279b7c9d', 'volume_name': 'volume-9f75dece-92d2-4ca8-8a59-0136279b7c9d', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14e3663-fa75-4cec-af1e-ed5cfd78f834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14e3663-fa75-4cec-af1e-ed5cfd78f834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (448dbb88-7ebf-496b-8963-4dd5d1db8336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:37 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Volume 9f75dece-92d2-4ca8-8a59-0136279b7c9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f75dece-92d2-4ca8-8a59-0136279b7c9d', 'volume_size': 1} Jun 04 06:39:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:39:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:39:37 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1401226281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f75dece-92d2-4ca8-8a59-0136279b7c9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82fcae418bda4e2e8ed2933d03ea0658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:39:38Z,use_quota=True,user_id='4ecb754f66f8484aac2a61a1f0856bcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:39:37 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Creating volume 9f75dece-92d2-4ca8-8a59-0136279b7c9d {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:39:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:39:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:39:37 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:39:37 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:39:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:39:37 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:39:37 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:39:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9f75dece-92d2-4ca8-8a59-0136279b7c9d 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:37 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[a429f61b-6718-4ff0-b41d-995ae97e0b62]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:39:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa4c2c97-c1fa-430a-9aa8-37e48783e95f_wnctjtuldevstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:37 devstack sudo[100536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9f75dece-92d2-4ca8-8a59-0136279b7c9d 1073741824 Jun 04 06:39:37 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:37 devstack sudo[100537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa4c2c97-c1fa-430a-9aa8-37e48783e95f_wnctjtuldevstack@QuobyteHD Jun 04 06:39:37 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:38 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa4c2c97-c1fa-430a-9aa8-37e48783e95f_wnctjtuldevstack@QuobyteHD" returned: 0 in 0.747s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:38 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] aa4c2c97-c1fa-430a-9aa8-37e48783e95f was qcow2, converting to raw {{(pid=86069) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 04 06:39:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa4c2c97-c1fa-430a-9aa8-37e48783e95f_wnctjtuldevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:38 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa4c2c97-c1fa-430a-9aa8-37e48783e95f_wnctjtuldevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4 Jun 04 06:39:38 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:38 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9f75dece-92d2-4ca8-8a59-0136279b7c9d 1073741824" returned: 0 in 0.902s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9f75dece-92d2-4ca8-8a59-0136279b7c9d {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:38 devstack sudo[100548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9f75dece-92d2-4ca8-8a59-0136279b7c9d Jun 04 06:39:38 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:39 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9f75dece-92d2-4ca8-8a59-0136279b7c9d" returned: 0 in 0.720s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:39 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:39:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:39:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (448dbb88-7ebf-496b-8963-4dd5d1db8336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f75dece-92d2-4ca8-8a59-0136279b7c9d', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9ce1485-076b-4a67-906a-a2c143b5d97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:39 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Volume volume-9f75dece-92d2-4ca8-8a59-0136279b7c9d (9f75dece-92d2-4ca8-8a59-0136279b7c9d): created successfully Jun 04 06:39:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9ce1485-076b-4a67-906a-a2c143b5d97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Flow 'volume_create_manager' (e1489d5c-4d64-481e-bdf1-0af11095bcf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:39:39 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-60629139-4ffb-40c0-92fd-1e656aaf4a85 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Created volume successfully. Jun 04 06:39:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-44f297ee-a9c5-4643-a678-687086e118d7 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Acquiring lock "cinder-9f75dece-92d2-4ca8-8a59-0136279b7c9d-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:39:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-44f297ee-a9c5-4643-a678-687086e118d7 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Lock "cinder-9f75dece-92d2-4ca8-8a59-0136279b7c9d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:39:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-44f297ee-a9c5-4643-a678-687086e118d7 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Acquiring lock "cinder-quobyte-9f75dece-92d2-4ca8-8a59-0136279b7c9d" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:39:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-44f297ee-a9c5-4643-a678-687086e118d7 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Lock "cinder-quobyte-9f75dece-92d2-4ca8-8a59-0136279b7c9d" acquired by "delete_volume" :: waited 0.019s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:39:39 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab113e23-c8aa-41df-aa11-c4fc369e580f]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:39:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-44f297ee-a9c5-4643-a678-687086e118d7 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9f75dece-92d2-4ca8-8a59-0136279b7c9d {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:40 devstack sudo[100558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9f75dece-92d2-4ca8-8a59-0136279b7c9d Jun 04 06:39:40 devstack sudo[100558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:40 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa4c2c97-c1fa-430a-9aa8-37e48783e95f_wnctjtuldevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4" returned: 0 in 1.917s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:40 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_aa4c2c97-c1fa-430a-9aa8-37e48783e95f_wnctjtuldevstack@QuobyteHD, size 112.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4 {{(pid=86069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 06:39:40 devstack cinder-volume[86069]: INFO cinder.image.image_utils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Converted 112.00 MB image at 58.40 MB/s Jun 04 06:39:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:40 devstack sudo[100560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4 1G Jun 04 06:39:40 devstack sudo[100560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:40 devstack sudo[100558]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-44f297ee-a9c5-4643-a678-687086e118d7 tempest-VolumeQuotasAdminTestJSON-1320014999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9f75dece-92d2-4ca8-8a59-0136279b7c9d" returned: 0 in 0.778s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-44f297ee-a9c5-4643-a678-687086e118d7 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9f75dece-92d2-4ca8-8a59-0136279b7c9d {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:40 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9f75dece-92d2-4ca8-8a59-0136279b7c9d Jun 04 06:39:40 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:41 devstack sudo[100560]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4 1G" returned: 0 in 0.755s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:41 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c234b8-a117-41a6-ad9e-684c07791943]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:39:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:41 devstack sudo[100570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4 Jun 04 06:39:41 devstack sudo[100570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:41 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-44f297ee-a9c5-4643-a678-687086e118d7 tempest-VolumeQuotasAdminTestJSON-1320014999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-9f75dece-92d2-4ca8-8a59-0136279b7c9d" returned: 0 in 0.597s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:41 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-44f297ee-a9c5-4643-a678-687086e118d7 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Lock "cinder-quobyte-9f75dece-92d2-4ca8-8a59-0136279b7c9d" released by "delete_volume" :: held 1.429s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:39:41 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-44f297ee-a9c5-4643-a678-687086e118d7 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Created reservations ['9ce5164b-71e6-4706-a2b4-79b87b852e84', '5fdb8ce7-0c3a-4f49-b1ab-28b58fa6376c', 'f5f264ad-dbfb-4db8-b0eb-4918691ccf64', '316f4eb3-a727-4564-9584-62d21bbdff9f'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:39:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-44f297ee-a9c5-4643-a678-687086e118d7 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:39:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-44f297ee-a9c5-4643-a678-687086e118d7 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:39:41 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-44f297ee-a9c5-4643-a678-687086e118d7 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:39:41 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-44f297ee-a9c5-4643-a678-687086e118d7 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:39:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-44f297ee-a9c5-4643-a678-687086e118d7 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:39:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-44f297ee-a9c5-4643-a678-687086e118d7 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:41 devstack sudo[100573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:39:41 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:41 devstack sudo[100570]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4" returned: 0 in 0.732s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:42 devstack sudo[100577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4 Jun 04 06:39:42 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:42 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-44f297ee-a9c5-4643-a678-687086e118d7 tempest-VolumeQuotasAdminTestJSON-1320014999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.696s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-44f297ee-a9c5-4643-a678-687086e118d7 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:39:42 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-44f297ee-a9c5-4643-a678-687086e118d7 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Deleted volume successfully. Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-44f297ee-a9c5-4643-a678-687086e118d7 tempest-VolumeQuotasAdminTestJSON-1320014999 None] Lock "cinder-9f75dece-92d2-4ca8-8a59-0136279b7c9d-delete_volume" released by "delete_volume" :: held 2.395s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] Flow 'volume_create_manager' (1db48347-9e29-4f4e-b8eb-aeb7198cca04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f72ccd1-029d-40eb-a682-20cad4f2ddf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f72ccd1-029d-40eb-a682-20cad4f2ddf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-852799207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77f31481-e2bb-47e4-bfe0-adfa0498ae91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82fcae418bda4e2e8ed2933d03ea0658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:39:43Z,use_quota=True,user_id='4ecb754f66f8484aac2a61a1f0856bcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1a95e7-1b80-4ece-a28e-e2546d3af875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1a95e7-1b80-4ece-a28e-e2546d3af875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20813b68-269b-4736-b55b-b36ef71abdf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20813b68-269b-4736-b55b-b36ef71abdf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77f31481-e2bb-47e4-bfe0-adfa0498ae91', 'volume_name': 'volume-77f31481-e2bb-47e4-bfe0-adfa0498ae91', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6fcc0fd-316f-443e-91be-43b87a9d15b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6fcc0fd-316f-443e-91be-43b87a9d15b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bfd2778-2594-45a9-88a1-3875d91cdde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:42 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] Volume 77f31481-e2bb-47e4-bfe0-adfa0498ae91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77f31481-e2bb-47e4-bfe0-adfa0498ae91', 'volume_size': 1} Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-852799207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77f31481-e2bb-47e4-bfe0-adfa0498ae91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82fcae418bda4e2e8ed2933d03ea0658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:39:43Z,use_quota=True,user_id='4ecb754f66f8484aac2a61a1f0856bcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] Creating volume 77f31481-e2bb-47e4-bfe0-adfa0498ae91 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:39:42 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:39:42 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-77f31481-e2bb-47e4-bfe0-adfa0498ae91 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4" returned: 1 in 0.751s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG cinder.volume.volume_utils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Downloaded image aa4c2c97-c1fa-430a-9aa8-37e48783e95f ((None, [{'url': 'file:///opt/stack/data/glance/images/aa4c2c97-c1fa-430a-9aa8-37e48783e95f', 'metadata': {}}])) to volume 7d96b2fa-7747-48d3-9976-dd1c30d264a4 successfully. {{(pid=86069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Temporary image aa4c2c97-c1fa-430a-9aa8-37e48783e95f for user 4fb9fef48fcf4e8a853d3637ba18a404 is deleted. {{(pid=86069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG cinder.volume.volume_utils [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Marking volume 7d96b2fa-7747-48d3-9976-dd1c30d264a4 as bootable. {{(pid=86069) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 04 06:39:42 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-77f31481-e2bb-47e4-bfe0-adfa0498ae91 1073741824 Jun 04 06:39:42 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Copying metadata from image aa4c2c97-c1fa-430a-9aa8-37e48783e95f to 7d96b2fa-7747-48d3-9976-dd1c30d264a4. {{(pid=86069) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Creating volume glance metadata for volume 7d96b2fa-7747-48d3-9976-dd1c30d264a4 backed by image aa4c2c97-c1fa-430a-9aa8-37e48783e95f with: {'image_id': 'aa4c2c97-c1fa-430a-9aa8-37e48783e95f', 'image_name': 'tempest-scenario-img--1226933186', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86069) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e1ff8b4-3698-4ac3-87ee-8c6d1f6ec8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4', 'volume_size': 1, 'image_id': 'aa4c2c97-c1fa-430a-9aa8-37e48783e95f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa4c2c97-c1fa-430a-9aa8-37e48783e95f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1226933186', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '04c4e26e02804efc94cc42ed22acb3bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa4c2c97-c1fa-430a-9aa8-37e48783e95f', 'created_at': datetime.datetime(2026, 6, 4, 4, 39, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 4, 39, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa4c2c97-c1fa-430a-9aa8-37e48783e95f/file', 'properties': {}}, 'image_service': }' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46047f93-98a8-4861-8a8d-20aa7bf66af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:42 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Volume volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4 (7d96b2fa-7747-48d3-9976-dd1c30d264a4): created successfully Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46047f93-98a8-4861-8a8d-20aa7bf66af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:42 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Flow 'volume_create_manager' (fc9c7b0e-f6a7-497f-b170-9eec038bc29f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:39:42 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-08ada3c0-839d-4942-8637-d213fa4dc122 tempest-TestInstancesWithCinderVolumes-1114328522 None] Created volume successfully. Jun 04 06:39:43 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-77f31481-e2bb-47e4-bfe0-adfa0498ae91 1073741824" returned: 0 in 0.949s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-77f31481-e2bb-47e4-bfe0-adfa0498ae91 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:43 devstack sudo[100589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-77f31481-e2bb-47e4-bfe0-adfa0498ae91 Jun 04 06:39:43 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:44 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-77f31481-e2bb-47e4-bfe0-adfa0498ae91" returned: 0 in 0.750s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:44 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:39:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:39:44 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bfd2778-2594-45a9-88a1-3875d91cdde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77f31481-e2bb-47e4-bfe0-adfa0498ae91', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:44 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe64580-796f-4745-bd06-ab0e7a12a06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:44 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] Volume volume-77f31481-e2bb-47e4-bfe0-adfa0498ae91 (77f31481-e2bb-47e4-bfe0-adfa0498ae91): created successfully Jun 04 06:39:44 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe64580-796f-4745-bd06-ab0e7a12a06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:44 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] Flow 'volume_create_manager' (1db48347-9e29-4f4e-b8eb-aeb7198cca04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:39:44 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-3edc22f0-3bf1-4126-aea9-cfc42a87bf5a tempest-VolumeQuotasAdminTestJSON-1320014999 None] Created volume successfully. Jun 04 06:39:45 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-a1d1ca7e-6853-4fe0-85ea-0a4f160b5679 tempest-VolumeQuotasAdminTestJSON-1231552249 None] Transfer volume completed successfully. Jun 04 06:39:46 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-2a93c19c-b198-485e-a91c-5b9f77c19c58 tempest-VolumeQuotasAdminTestJSON-979836985 None] Acquiring lock "cinder-77f31481-e2bb-47e4-bfe0-adfa0498ae91-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:39:46 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-2a93c19c-b198-485e-a91c-5b9f77c19c58 tempest-VolumeQuotasAdminTestJSON-979836985 None] Lock "cinder-77f31481-e2bb-47e4-bfe0-adfa0498ae91-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:39:46 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-2a93c19c-b198-485e-a91c-5b9f77c19c58 tempest-VolumeQuotasAdminTestJSON-979836985 None] Acquiring lock "cinder-quobyte-77f31481-e2bb-47e4-bfe0-adfa0498ae91" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:39:46 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-2a93c19c-b198-485e-a91c-5b9f77c19c58 tempest-VolumeQuotasAdminTestJSON-979836985 None] Lock "cinder-quobyte-77f31481-e2bb-47e4-bfe0-adfa0498ae91" acquired by "delete_volume" :: waited 0.017s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:39:46 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[9986a289-a297-4490-9198-37f50702c42d]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:39:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-2a93c19c-b198-485e-a91c-5b9f77c19c58 tempest-VolumeQuotasAdminTestJSON-979836985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-77f31481-e2bb-47e4-bfe0-adfa0498ae91 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:46 devstack sudo[100594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-77f31481-e2bb-47e4-bfe0-adfa0498ae91 Jun 04 06:39:46 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:47 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-2a93c19c-b198-485e-a91c-5b9f77c19c58 tempest-VolumeQuotasAdminTestJSON-979836985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-77f31481-e2bb-47e4-bfe0-adfa0498ae91" returned: 0 in 0.755s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-2a93c19c-b198-485e-a91c-5b9f77c19c58 tempest-VolumeQuotasAdminTestJSON-979836985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-77f31481-e2bb-47e4-bfe0-adfa0498ae91 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:47 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-77f31481-e2bb-47e4-bfe0-adfa0498ae91 Jun 04 06:39:47 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:47 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-2a93c19c-b198-485e-a91c-5b9f77c19c58 tempest-VolumeQuotasAdminTestJSON-979836985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-77f31481-e2bb-47e4-bfe0-adfa0498ae91" returned: 0 in 0.614s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:47 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-2a93c19c-b198-485e-a91c-5b9f77c19c58 tempest-VolumeQuotasAdminTestJSON-979836985 None] Lock "cinder-quobyte-77f31481-e2bb-47e4-bfe0-adfa0498ae91" released by "delete_volume" :: held 1.417s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:39:47 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-2a93c19c-b198-485e-a91c-5b9f77c19c58 tempest-VolumeQuotasAdminTestJSON-979836985 None] Created reservations ['6090587c-3094-4928-8e69-d8af66c34132', '7e404cb1-ab42-43fe-812e-8c14b406f1af', '812694f9-00b9-4746-b244-f07107e9de83', 'cdd54bdb-0112-429e-b11a-2b19d435fd94'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:39:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-2a93c19c-b198-485e-a91c-5b9f77c19c58 tempest-VolumeQuotasAdminTestJSON-979836985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:39:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-2a93c19c-b198-485e-a91c-5b9f77c19c58 tempest-VolumeQuotasAdminTestJSON-979836985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:39:48 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-2a93c19c-b198-485e-a91c-5b9f77c19c58 tempest-VolumeQuotasAdminTestJSON-979836985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:39:48 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-2a93c19c-b198-485e-a91c-5b9f77c19c58 tempest-VolumeQuotasAdminTestJSON-979836985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:39:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-2a93c19c-b198-485e-a91c-5b9f77c19c58 tempest-VolumeQuotasAdminTestJSON-979836985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:39:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-2a93c19c-b198-485e-a91c-5b9f77c19c58 tempest-VolumeQuotasAdminTestJSON-979836985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:48 devstack sudo[100604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:39:48 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:48 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-2a93c19c-b198-485e-a91c-5b9f77c19c58 tempest-VolumeQuotasAdminTestJSON-979836985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.608s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:48 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-2a93c19c-b198-485e-a91c-5b9f77c19c58 tempest-VolumeQuotasAdminTestJSON-979836985 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:39:48 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-2a93c19c-b198-485e-a91c-5b9f77c19c58 tempest-VolumeQuotasAdminTestJSON-979836985 None] Deleted volume successfully. Jun 04 06:39:48 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-2a93c19c-b198-485e-a91c-5b9f77c19c58 tempest-VolumeQuotasAdminTestJSON-979836985 None] Lock "cinder-77f31481-e2bb-47e4-bfe0-adfa0498ae91-delete_volume" released by "delete_volume" :: held 2.234s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:39:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-bb0fb5d8-cd84-42fd-b769-42c904e13bd9 req-1240478b-9695-46ee-ae70-a8c3150de1d5 tempest-TestInstancesWithCinderVolumes-1114328522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:39:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-bb0fb5d8-cd84-42fd-b769-42c904e13bd9 req-1240478b-9695-46ee-ae70-a8c3150de1d5 tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:39:51 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41c1843-b5f9-4e60-bbe8-16d21f9135ca]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:39:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-bb0fb5d8-cd84-42fd-b769-42c904e13bd9 req-1240478b-9695-46ee-ae70-a8c3150de1d5 tempest-TestInstancesWithCinderVolumes-1114328522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:51 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4 Jun 04 06:39:51 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:52 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-bb0fb5d8-cd84-42fd-b769-42c904e13bd9 req-1240478b-9695-46ee-ae70-a8c3150de1d5 tempest-TestInstancesWithCinderVolumes-1114328522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4" returned: 0 in 0.800s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-bb0fb5d8-cd84-42fd-b769-42c904e13bd9 req-1240478b-9695-46ee-ae70-a8c3150de1d5 tempest-TestInstancesWithCinderVolumes-1114328522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:52 devstack sudo[100622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4 Jun 04 06:39:52 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:52 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-bb0fb5d8-cd84-42fd-b769-42c904e13bd9 req-1240478b-9695-46ee-ae70-a8c3150de1d5 tempest-TestInstancesWithCinderVolumes-1114328522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4" returned: 1 in 0.847s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-bb0fb5d8-cd84-42fd-b769-42c904e13bd9 req-1240478b-9695-46ee-ae70-a8c3150de1d5 tempest-TestInstancesWithCinderVolumes-1114328522 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:39:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-bb0fb5d8-cd84-42fd-b769-42c904e13bd9 req-1240478b-9695-46ee-ae70-a8c3150de1d5 tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.692s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:39:52 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-bb0fb5d8-cd84-42fd-b769-42c904e13bd9 req-1240478b-9695-46ee-ae70-a8c3150de1d5 tempest-TestInstancesWithCinderVolumes-1114328522 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574', 'name': 'volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd939fe24-3b88-4b7e-8326-7e0866c15365', 'enforce_multipath': True} {{(pid=86069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 06:39:53 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-bb0fb5d8-cd84-42fd-b769-42c904e13bd9 req-1240478b-9695-46ee-ae70-a8c3150de1d5 tempest-TestInstancesWithCinderVolumes-1114328522 None] attachment_update completed successfully. Jun 04 06:39:56 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:39:56 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Flow 'volume_create_manager' (7780e505-e3be-4bb0-a5f5-51c86d91f1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:39:56 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d12afe-349f-4841-8845-1a867a2084b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:56 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d12afe-349f-4841-8845-1a867a2084b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1856719585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a3a10c0-328f-4ca6-8de7-35358909ef17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37dd73e3552943babedd9a058cc77b0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:39:56Z,use_quota=True,user_id='6049cecfbcf546f8bbec81bccbeb94a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:56 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e9381c9-989b-45b9-be6a-2d66d27bbf08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:56 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e9381c9-989b-45b9-be6a-2d66d27bbf08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:56 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be459741-9a35-4b19-9c80-52b08be246e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:56 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be459741-9a35-4b19-9c80-52b08be246e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a3a10c0-328f-4ca6-8de7-35358909ef17', 'volume_name': 'volume-5a3a10c0-328f-4ca6-8de7-35358909ef17', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:56 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eba30c7-0315-4c59-8e5b-ec15fc52b62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:56 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eba30c7-0315-4c59-8e5b-ec15fc52b62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:56 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd6b1d9-bbf6-49a7-80b0-22fbe3f621f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:56 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Volume 5a3a10c0-328f-4ca6-8de7-35358909ef17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a3a10c0-328f-4ca6-8de7-35358909ef17', 'volume_size': 1} Jun 04 06:39:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:39:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:39:56 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1856719585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a3a10c0-328f-4ca6-8de7-35358909ef17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37dd73e3552943babedd9a058cc77b0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:39:56Z,use_quota=True,user_id='6049cecfbcf546f8bbec81bccbeb94a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:39:56 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Creating volume 5a3a10c0-328f-4ca6-8de7-35358909ef17 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:39:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:39:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:39:56 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:39:56 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:39:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:39:56 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:39:56 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:39:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5a3a10c0-328f-4ca6-8de7-35358909ef17 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:56 devstack sudo[100696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5a3a10c0-328f-4ca6-8de7-35358909ef17 1073741824 Jun 04 06:39:56 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:56 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5a3a10c0-328f-4ca6-8de7-35358909ef17 1073741824" returned: 0 in 0.791s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5a3a10c0-328f-4ca6-8de7-35358909ef17 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:57 devstack sudo[100706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5a3a10c0-328f-4ca6-8de7-35358909ef17 Jun 04 06:39:57 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:39:57 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root Jun 04 06:39:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5a3a10c0-328f-4ca6-8de7-35358909ef17" returned: 0 in 0.577s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:39:57 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:39:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:39:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd6b1d9-bbf6-49a7-80b0-22fbe3f621f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a3a10c0-328f-4ca6-8de7-35358909ef17', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a9eccb-5faf-4782-acba-533f0510918e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:39:57 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Volume volume-5a3a10c0-328f-4ca6-8de7-35358909ef17 (5a3a10c0-328f-4ca6-8de7-35358909ef17): created successfully Jun 04 06:39:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a9eccb-5faf-4782-acba-533f0510918e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:39:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Flow 'volume_create_manager' (7780e505-e3be-4bb0-a5f5-51c86d91f1a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:39:57 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-32bcff46-f86a-4829-ab5d-6100564f7190 tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Created volume successfully. Jun 04 06:39:59 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0bc8aa8a-6662-42d8-81e6-db4735554b4a tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Acquiring lock "cinder-5a3a10c0-328f-4ca6-8de7-35358909ef17-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:39:59 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0bc8aa8a-6662-42d8-81e6-db4735554b4a tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Lock "cinder-5a3a10c0-328f-4ca6-8de7-35358909ef17-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:39:59 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0bc8aa8a-6662-42d8-81e6-db4735554b4a tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Acquiring lock "cinder-quobyte-5a3a10c0-328f-4ca6-8de7-35358909ef17" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:39:59 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0bc8aa8a-6662-42d8-81e6-db4735554b4a tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Lock "cinder-quobyte-5a3a10c0-328f-4ca6-8de7-35358909ef17" acquired by "delete_volume" :: waited 0.020s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:39:59 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[28eae4c5-8e76-4656-96c0-be20bfc1091a]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:39:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0bc8aa8a-6662-42d8-81e6-db4735554b4a tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5a3a10c0-328f-4ca6-8de7-35358909ef17 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:39:59 devstack sudo[101083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5a3a10c0-328f-4ca6-8de7-35358909ef17 Jun 04 06:39:59 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:40:00 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root Jun 04 06:40:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0bc8aa8a-6662-42d8-81e6-db4735554b4a tempest-VolumeQuotasNegativeTestJSON-1454459162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5a3a10c0-328f-4ca6-8de7-35358909ef17" returned: 0 in 0.745s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:40:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0bc8aa8a-6662-42d8-81e6-db4735554b4a tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5a3a10c0-328f-4ca6-8de7-35358909ef17 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:40:00 devstack sudo[101089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5a3a10c0-328f-4ca6-8de7-35358909ef17 Jun 04 06:40:00 devstack sudo[101089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:40:01 devstack sudo[101089]: pam_unix(sudo:session): session closed for user root Jun 04 06:40:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0bc8aa8a-6662-42d8-81e6-db4735554b4a tempest-VolumeQuotasNegativeTestJSON-1454459162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-5a3a10c0-328f-4ca6-8de7-35358909ef17" returned: 0 in 0.655s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:40:01 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0bc8aa8a-6662-42d8-81e6-db4735554b4a tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Lock "cinder-quobyte-5a3a10c0-328f-4ca6-8de7-35358909ef17" released by "delete_volume" :: held 1.446s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:40:01 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-0bc8aa8a-6662-42d8-81e6-db4735554b4a tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Created reservations ['dea014ac-dde3-4174-92e8-bf0db44da7c4', '839b4d4f-6cfc-4f20-bdc2-de2a921aa290', '6786be68-d533-4c35-b182-eec6166899b3', '6c01f900-e896-4ab5-a379-8f900ace776e'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:40:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0bc8aa8a-6662-42d8-81e6-db4735554b4a tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:40:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0bc8aa8a-6662-42d8-81e6-db4735554b4a tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:40:01 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0bc8aa8a-6662-42d8-81e6-db4735554b4a tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:40:01 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0bc8aa8a-6662-42d8-81e6-db4735554b4a tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:40:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0bc8aa8a-6662-42d8-81e6-db4735554b4a tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:40:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0bc8aa8a-6662-42d8-81e6-db4735554b4a tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:40:01 devstack sudo[101092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:40:01 devstack sudo[101092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:40:01 devstack sudo[101092]: pam_unix(sudo:session): session closed for user root Jun 04 06:40:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0bc8aa8a-6662-42d8-81e6-db4735554b4a tempest-VolumeQuotasNegativeTestJSON-1454459162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.686s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:40:01 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-0bc8aa8a-6662-42d8-81e6-db4735554b4a tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:40:01 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-0bc8aa8a-6662-42d8-81e6-db4735554b4a tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Deleted volume successfully. Jun 04 06:40:02 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0bc8aa8a-6662-42d8-81e6-db4735554b4a tempest-VolumeQuotasNegativeTestJSON-1454459162 None] Lock "cinder-5a3a10c0-328f-4ca6-8de7-35358909ef17-delete_volume" released by "delete_volume" :: held 2.383s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:40:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:40:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:40:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:40:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:40:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:40:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:40:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:40:11 devstack sudo[101103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:40:11 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:40:11 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root Jun 04 06:40:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.633s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:40:11 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:40:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager._thread_info {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:40:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread count: 28 {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 06:40:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread info: [<_MainThread(MainThread, started 131797370544256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 06:40:13 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=63,cinder:UPDATE=78,cinder:INSERT=18,cinder:DELETE=7 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:40:13 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=61,cinder:UPDATE=71,cinder:DELETE=7,cinder:INSERT=24 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:40:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-d534b2a7-872b-4e63-bc7a-e0025d6f7718 req-1681e06a-4b21-4bab-98a5-6ccf78eceec1 tempest-TestInstancesWithCinderVolumes-1114328522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:40:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-d534b2a7-872b-4e63-bc7a-e0025d6f7718 req-1681e06a-4b21-4bab-98a5-6ccf78eceec1 tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:40:32 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eda44a3-8c21-42fe-865f-f79aff22b8e5]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:40:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-d534b2a7-872b-4e63-bc7a-e0025d6f7718 req-1681e06a-4b21-4bab-98a5-6ccf78eceec1 tempest-TestInstancesWithCinderVolumes-1114328522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e16e316b-22b2-4496-b9c2-73e3ff02d3ae {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:40:32 devstack sudo[101246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e16e316b-22b2-4496-b9c2-73e3ff02d3ae Jun 04 06:40:32 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:40:33 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root Jun 04 06:40:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-d534b2a7-872b-4e63-bc7a-e0025d6f7718 req-1681e06a-4b21-4bab-98a5-6ccf78eceec1 tempest-TestInstancesWithCinderVolumes-1114328522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e16e316b-22b2-4496-b9c2-73e3ff02d3ae" returned: 0 in 0.860s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:40:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-d534b2a7-872b-4e63-bc7a-e0025d6f7718 req-1681e06a-4b21-4bab-98a5-6ccf78eceec1 tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.892s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:40:33 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-d534b2a7-872b-4e63-bc7a-e0025d6f7718 req-1681e06a-4b21-4bab-98a5-6ccf78eceec1 tempest-TestInstancesWithCinderVolumes-1114328522 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574', 'name': 'volume-e16e316b-22b2-4496-b9c2-73e3ff02d3ae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '85ef5b1f-d1a5-42c0-bb39-e9b9a16ac6fb', 'enforce_multipath': True} {{(pid=86069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 06:40:33 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-d534b2a7-872b-4e63-bc7a-e0025d6f7718 req-1681e06a-4b21-4bab-98a5-6ccf78eceec1 tempest-TestInstancesWithCinderVolumes-1114328522 None] attachment_update completed successfully. Jun 04 06:40:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-e225de93-12a9-4357-9845-a47ec2b874b0 req-1e8ee969-de45-4b03-8534-b4efbca8dad3 tempest-TestInstancesWithCinderVolumes-1114328522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:40:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-e225de93-12a9-4357-9845-a47ec2b874b0 req-1e8ee969-de45-4b03-8534-b4efbca8dad3 tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:40:40 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[1184f3a5-59aa-460c-84a1-fcc27807b57b]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:40:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-e225de93-12a9-4357-9845-a47ec2b874b0 req-1e8ee969-de45-4b03-8534-b4efbca8dad3 tempest-TestInstancesWithCinderVolumes-1114328522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9aebd60-4028-4a2b-80b0-ac0072329627 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:40:41 devstack sudo[101274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9aebd60-4028-4a2b-80b0-ac0072329627 Jun 04 06:40:41 devstack sudo[101274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:40:41 devstack sudo[101274]: pam_unix(sudo:session): session closed for user root Jun 04 06:40:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-e225de93-12a9-4357-9845-a47ec2b874b0 req-1e8ee969-de45-4b03-8534-b4efbca8dad3 tempest-TestInstancesWithCinderVolumes-1114328522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9aebd60-4028-4a2b-80b0-ac0072329627" returned: 0 in 0.776s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:40:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-e225de93-12a9-4357-9845-a47ec2b874b0 req-1e8ee969-de45-4b03-8534-b4efbca8dad3 tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.796s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:40:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-e225de93-12a9-4357-9845-a47ec2b874b0 req-1e8ee969-de45-4b03-8534-b4efbca8dad3 tempest-TestInstancesWithCinderVolumes-1114328522 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574', 'name': 'volume-c9aebd60-4028-4a2b-80b0-ac0072329627', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bb332eda-74f9-4340-852e-d3b3d6fd4a07', 'enforce_multipath': True} {{(pid=86069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 06:40:41 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-e225de93-12a9-4357-9845-a47ec2b874b0 req-1e8ee969-de45-4b03-8534-b4efbca8dad3 tempest-TestInstancesWithCinderVolumes-1114328522 None] attachment_update completed successfully. Jun 04 06:40:51 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-d8a1df8d-e43d-4a9d-81c3-bfb48f955cbc req-c3d051e0-48f9-4b3b-9a17-563cadd32f64 tempest-TestInstancesWithCinderVolumes-1114328522 None] Terminate volume connection completed successfully. Jun 04 06:40:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-d8a1df8d-e43d-4a9d-81c3-bfb48f955cbc req-c3d051e0-48f9-4b3b-9a17-563cadd32f64 tempest-TestInstancesWithCinderVolumes-1114328522 None] Deleting attachment 85ef5b1f-d1a5-42c0-bb39-e9b9a16ac6fb. {{(pid=86069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 06:40:53 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4b35578b-706d-4943-97bf-6b8f5f9350c1 tempest-TestInstancesWithCinderVolumes-1114328522 None] Acquiring lock "cinder-e16e316b-22b2-4496-b9c2-73e3ff02d3ae-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:40:53 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4b35578b-706d-4943-97bf-6b8f5f9350c1 tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "cinder-e16e316b-22b2-4496-b9c2-73e3ff02d3ae-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:40:53 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4b35578b-706d-4943-97bf-6b8f5f9350c1 tempest-TestInstancesWithCinderVolumes-1114328522 None] Acquiring lock "cinder-quobyte-e16e316b-22b2-4496-b9c2-73e3ff02d3ae" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:40:53 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4b35578b-706d-4943-97bf-6b8f5f9350c1 tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "cinder-quobyte-e16e316b-22b2-4496-b9c2-73e3ff02d3ae" acquired by "delete_volume" :: waited 0.014s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:40:53 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92ce59f-e5ef-4c9e-9d0c-b3a0ad77c302]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:40:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4b35578b-706d-4943-97bf-6b8f5f9350c1 tempest-TestInstancesWithCinderVolumes-1114328522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e16e316b-22b2-4496-b9c2-73e3ff02d3ae {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:40:53 devstack sudo[101342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e16e316b-22b2-4496-b9c2-73e3ff02d3ae Jun 04 06:40:53 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:40:54 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root Jun 04 06:40:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4b35578b-706d-4943-97bf-6b8f5f9350c1 tempest-TestInstancesWithCinderVolumes-1114328522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e16e316b-22b2-4496-b9c2-73e3ff02d3ae" returned: 0 in 1.444s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:40:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4b35578b-706d-4943-97bf-6b8f5f9350c1 tempest-TestInstancesWithCinderVolumes-1114328522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e16e316b-22b2-4496-b9c2-73e3ff02d3ae {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:40:54 devstack sudo[101411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e16e316b-22b2-4496-b9c2-73e3ff02d3ae Jun 04 06:40:54 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:40:55 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root Jun 04 06:40:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4b35578b-706d-4943-97bf-6b8f5f9350c1 tempest-TestInstancesWithCinderVolumes-1114328522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e16e316b-22b2-4496-b9c2-73e3ff02d3ae" returned: 0 in 0.712s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:40:55 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4b35578b-706d-4943-97bf-6b8f5f9350c1 tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "cinder-quobyte-e16e316b-22b2-4496-b9c2-73e3ff02d3ae" released by "delete_volume" :: held 2.213s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:40:55 devstack cinder-volume[86069]: WARNING cinder.quota [None req-4b35578b-706d-4943-97bf-6b8f5f9350c1 tempest-TestInstancesWithCinderVolumes-1114328522 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1825839360-1105641022 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1825839360-1105641022, it is now deprecated. Please use the default quota class for default quota. Jun 04 06:40:55 devstack cinder-volume[86069]: WARNING cinder.quota [None req-4b35578b-706d-4943-97bf-6b8f5f9350c1 tempest-TestInstancesWithCinderVolumes-1114328522 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1825839360-1105641022 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1825839360-1105641022, it is now deprecated. Please use the default quota class for default quota. Jun 04 06:40:55 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-4b35578b-706d-4943-97bf-6b8f5f9350c1 tempest-TestInstancesWithCinderVolumes-1114328522 None] Created reservations ['a05ae28e-36af-4793-8a80-a9cb1ee41d78', '7a365c25-2d8c-4a7c-b511-444406c7d8e7', 'f902a9d8-1e71-49ce-a5de-409154ea23aa', 'f3de2597-092e-42c6-a3d1-120a3b9d9ffc'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:40:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-4b35578b-706d-4943-97bf-6b8f5f9350c1 tempest-TestInstancesWithCinderVolumes-1114328522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:40:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-4b35578b-706d-4943-97bf-6b8f5f9350c1 tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:40:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-4b35578b-706d-4943-97bf-6b8f5f9350c1 tempest-TestInstancesWithCinderVolumes-1114328522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:40:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-4b35578b-706d-4943-97bf-6b8f5f9350c1 tempest-TestInstancesWithCinderVolumes-1114328522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:40:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-4b35578b-706d-4943-97bf-6b8f5f9350c1 tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:40:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4b35578b-706d-4943-97bf-6b8f5f9350c1 tempest-TestInstancesWithCinderVolumes-1114328522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:40:55 devstack sudo[101416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:40:55 devstack sudo[101416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:40:56 devstack sudo[101416]: pam_unix(sudo:session): session closed for user root Jun 04 06:40:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4b35578b-706d-4943-97bf-6b8f5f9350c1 tempest-TestInstancesWithCinderVolumes-1114328522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.724s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:40:56 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-4b35578b-706d-4943-97bf-6b8f5f9350c1 tempest-TestInstancesWithCinderVolumes-1114328522 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:40:56 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-4b35578b-706d-4943-97bf-6b8f5f9350c1 tempest-TestInstancesWithCinderVolumes-1114328522 None] Deleted volume successfully. Jun 04 06:40:56 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4b35578b-706d-4943-97bf-6b8f5f9350c1 tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "cinder-e16e316b-22b2-4496-b9c2-73e3ff02d3ae-delete_volume" released by "delete_volume" :: held 3.276s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:40:57 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:40:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] Flow 'volume_create_manager' (57a2a8d1-81fd-4dc6-bcb0-b52751599e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:40:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (186b5510-6301-48ec-9f57-33d86a77b845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:40:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (186b5510-6301-48ec-9f57-33d86a77b845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-780229370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b26d8c4b-3de4-40ed-9b9e-389051d7d2f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d12d7d55d1d403b9ac899abef7b66f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:40:58Z,use_quota=True,user_id='a1fb72527b334d2cb35f6faef9fca05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:40:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23da73dd-0d0f-43a0-aa22-a9bd7150663e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:40:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23da73dd-0d0f-43a0-aa22-a9bd7150663e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:40:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6715de9-b9b4-4cd1-9346-1049e5fd451c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:40:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6715de9-b9b4-4cd1-9346-1049e5fd451c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b26d8c4b-3de4-40ed-9b9e-389051d7d2f5', 'volume_name': 'volume-b26d8c4b-3de4-40ed-9b9e-389051d7d2f5', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:40:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3576060c-e7f3-4b8c-9411-214cba2ffa90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:40:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3576060c-e7f3-4b8c-9411-214cba2ffa90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:40:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f325cf-1ec5-4a44-ac6d-ee9cbe2ba709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:40:57 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] Volume b26d8c4b-3de4-40ed-9b9e-389051d7d2f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b26d8c4b-3de4-40ed-9b9e-389051d7d2f5', 'volume_size': 1} Jun 04 06:40:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:40:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:40:57 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-780229370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b26d8c4b-3de4-40ed-9b9e-389051d7d2f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d12d7d55d1d403b9ac899abef7b66f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:40:58Z,use_quota=True,user_id='a1fb72527b334d2cb35f6faef9fca05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:40:57 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] Creating volume b26d8c4b-3de4-40ed-9b9e-389051d7d2f5 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:40:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:40:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:40:57 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:40:57 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:40:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:40:57 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:40:57 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:40:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b26d8c4b-3de4-40ed-9b9e-389051d7d2f5 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:40:57 devstack sudo[101440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b26d8c4b-3de4-40ed-9b9e-389051d7d2f5 1073741824 Jun 04 06:40:57 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:40:58 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root Jun 04 06:40:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b26d8c4b-3de4-40ed-9b9e-389051d7d2f5 1073741824" returned: 0 in 0.887s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:40:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b26d8c4b-3de4-40ed-9b9e-389051d7d2f5 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:40:58 devstack sudo[101445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b26d8c4b-3de4-40ed-9b9e-389051d7d2f5 Jun 04 06:40:58 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:40:59 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-c005f5a5-9de0-479a-a3d4-7a7af7aa9599 req-add55248-d782-4d53-824c-06f9db761fb5 tempest-TestInstancesWithCinderVolumes-1114328522 None] Terminate volume connection completed successfully. Jun 04 06:40:59 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-c005f5a5-9de0-479a-a3d4-7a7af7aa9599 req-add55248-d782-4d53-824c-06f9db761fb5 tempest-TestInstancesWithCinderVolumes-1114328522 None] Deleting attachment bb332eda-74f9-4340-852e-d3b3d6fd4a07. {{(pid=86069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 06:40:59 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root Jun 04 06:40:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b26d8c4b-3de4-40ed-9b9e-389051d7d2f5" returned: 0 in 0.701s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:40:59 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:40:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:40:59 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f325cf-1ec5-4a44-ac6d-ee9cbe2ba709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b26d8c4b-3de4-40ed-9b9e-389051d7d2f5', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:40:59 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b31484e-3177-46ac-a7b2-5665b1c0f1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:40:59 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] Volume volume-b26d8c4b-3de4-40ed-9b9e-389051d7d2f5 (b26d8c4b-3de4-40ed-9b9e-389051d7d2f5): created successfully Jun 04 06:40:59 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b31484e-3177-46ac-a7b2-5665b1c0f1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:40:59 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] Flow 'volume_create_manager' (57a2a8d1-81fd-4dc6-bcb0-b52751599e23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:40:59 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-f56df393-3731-4ebb-9fe9-1dc71db0e60e tempest-VolumesActionsTest-1704680497 None] Created volume successfully. Jun 04 06:40:59 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0db8d1fb-0a81-4055-a5f0-b3b885e8c5da tempest-VolumesActionsTest-1704680497 None] Acquiring lock "cinder-b26d8c4b-3de4-40ed-9b9e-389051d7d2f5" by "attach_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:40:59 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0db8d1fb-0a81-4055-a5f0-b3b885e8c5da tempest-VolumesActionsTest-1704680497 None] Lock "cinder-b26d8c4b-3de4-40ed-9b9e-389051d7d2f5" acquired by "attach_volume" :: waited 0.022s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:40:59 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-0db8d1fb-0a81-4055-a5f0-b3b885e8c5da tempest-VolumesActionsTest-1704680497 None] Attaching volume b26d8c4b-3de4-40ed-9b9e-389051d7d2f5 to instance 275a6524-cdd6-464a-8c58-afd97469c4dc at mountpoint /dev/vdb on host None. Jun 04 06:40:59 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-0db8d1fb-0a81-4055-a5f0-b3b885e8c5da tempest-VolumesActionsTest-1704680497 None] Attach volume completed successfully. Jun 04 06:40:59 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0db8d1fb-0a81-4055-a5f0-b3b885e8c5da tempest-VolumesActionsTest-1704680497 None] Lock "cinder-b26d8c4b-3de4-40ed-9b9e-389051d7d2f5" released by "attach_volume" :: held 0.087s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:41:00 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-13addeeb-82e4-42d5-b8b8-070206cb2742 tempest-VolumesActionsTest-137902531 None] Terminate volume connection completed successfully. Jun 04 06:41:01 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-10bcdc34-2002-47c0-9c38-0a2f46dab243 tempest-TestInstancesWithCinderVolumes-1114328522 None] Acquiring lock "cinder-c9aebd60-4028-4a2b-80b0-ac0072329627-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:41:01 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-10bcdc34-2002-47c0-9c38-0a2f46dab243 tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "cinder-c9aebd60-4028-4a2b-80b0-ac0072329627-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:41:01 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-10bcdc34-2002-47c0-9c38-0a2f46dab243 tempest-TestInstancesWithCinderVolumes-1114328522 None] Acquiring lock "cinder-quobyte-c9aebd60-4028-4a2b-80b0-ac0072329627" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:41:01 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-10bcdc34-2002-47c0-9c38-0a2f46dab243 tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "cinder-quobyte-c9aebd60-4028-4a2b-80b0-ac0072329627" acquired by "delete_volume" :: waited 0.019s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:41:01 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ef10eb-f66e-4620-a2a6-632ce0af8da0]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:41:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-10bcdc34-2002-47c0-9c38-0a2f46dab243 tempest-TestInstancesWithCinderVolumes-1114328522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9aebd60-4028-4a2b-80b0-ac0072329627 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:01 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-13addeeb-82e4-42d5-b8b8-070206cb2742 tempest-VolumesActionsTest-137902531 None] Acquiring lock "cinder-b26d8c4b-3de4-40ed-9b9e-389051d7d2f5-detach_volume" by "detach_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:41:01 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-13addeeb-82e4-42d5-b8b8-070206cb2742 tempest-VolumesActionsTest-137902531 None] Lock "cinder-b26d8c4b-3de4-40ed-9b9e-389051d7d2f5-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:41:01 devstack sudo[101450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9aebd60-4028-4a2b-80b0-ac0072329627 Jun 04 06:41:01 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:01 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-13addeeb-82e4-42d5-b8b8-070206cb2742 tempest-VolumesActionsTest-137902531 None] Detaching volume b26d8c4b-3de4-40ed-9b9e-389051d7d2f5 from instance 275a6524-cdd6-464a-8c58-afd97469c4dc. Jun 04 06:41:01 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-13addeeb-82e4-42d5-b8b8-070206cb2742 tempest-VolumesActionsTest-137902531 None] Detach volume completed successfully. Jun 04 06:41:01 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-13addeeb-82e4-42d5-b8b8-070206cb2742 tempest-VolumesActionsTest-137902531 None] Lock "cinder-b26d8c4b-3de4-40ed-9b9e-389051d7d2f5-detach_volume" released by "detach_volume" :: held 0.105s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:41:02 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c731b745-cbc5-4ee6-bed6-fa8e66348ecb tempest-VolumesActionsTest-1704680497 None] Acquiring lock "cinder-b26d8c4b-3de4-40ed-9b9e-389051d7d2f5-detach_volume" by "detach_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:41:02 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c731b745-cbc5-4ee6-bed6-fa8e66348ecb tempest-VolumesActionsTest-1704680497 None] Lock "cinder-b26d8c4b-3de4-40ed-9b9e-389051d7d2f5-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:41:02 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-c731b745-cbc5-4ee6-bed6-fa8e66348ecb tempest-VolumesActionsTest-1704680497 None] Volume detach called, but volume not attached. Jun 04 06:41:02 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c731b745-cbc5-4ee6-bed6-fa8e66348ecb tempest-VolumesActionsTest-1704680497 None] Lock "cinder-b26d8c4b-3de4-40ed-9b9e-389051d7d2f5-detach_volume" released by "detach_volume" :: held 0.020s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:41:02 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-10bcdc34-2002-47c0-9c38-0a2f46dab243 tempest-TestInstancesWithCinderVolumes-1114328522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9aebd60-4028-4a2b-80b0-ac0072329627" returned: 0 in 1.032s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-10bcdc34-2002-47c0-9c38-0a2f46dab243 tempest-TestInstancesWithCinderVolumes-1114328522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9aebd60-4028-4a2b-80b0-ac0072329627 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:02 devstack sudo[101455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9aebd60-4028-4a2b-80b0-ac0072329627 Jun 04 06:41:02 devstack sudo[101455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:03 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c8eb8fa9-aa87-4e87-889e-3df58872b47f tempest-VolumesActionsTest-1704680497 None] Acquiring lock "cinder-b26d8c4b-3de4-40ed-9b9e-389051d7d2f5-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:41:03 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c8eb8fa9-aa87-4e87-889e-3df58872b47f tempest-VolumesActionsTest-1704680497 None] Lock "cinder-b26d8c4b-3de4-40ed-9b9e-389051d7d2f5-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:41:03 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c8eb8fa9-aa87-4e87-889e-3df58872b47f tempest-VolumesActionsTest-1704680497 None] Acquiring lock "cinder-quobyte-b26d8c4b-3de4-40ed-9b9e-389051d7d2f5" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:41:03 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c8eb8fa9-aa87-4e87-889e-3df58872b47f tempest-VolumesActionsTest-1704680497 None] Lock "cinder-quobyte-b26d8c4b-3de4-40ed-9b9e-389051d7d2f5" acquired by "delete_volume" :: waited 0.033s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:41:03 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be18c6f-eefd-44a9-acd8-1758f25309ed]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:41:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c8eb8fa9-aa87-4e87-889e-3df58872b47f tempest-VolumesActionsTest-1704680497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b26d8c4b-3de4-40ed-9b9e-389051d7d2f5 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:03 devstack sudo[101458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b26d8c4b-3de4-40ed-9b9e-389051d7d2f5 Jun 04 06:41:03 devstack sudo[101458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:03 devstack sudo[101455]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-10bcdc34-2002-47c0-9c38-0a2f46dab243 tempest-TestInstancesWithCinderVolumes-1114328522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c9aebd60-4028-4a2b-80b0-ac0072329627" returned: 0 in 1.132s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:03 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-10bcdc34-2002-47c0-9c38-0a2f46dab243 tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "cinder-quobyte-c9aebd60-4028-4a2b-80b0-ac0072329627" released by "delete_volume" :: held 2.218s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:41:03 devstack cinder-volume[86069]: WARNING cinder.quota [None req-10bcdc34-2002-47c0-9c38-0a2f46dab243 tempest-TestInstancesWithCinderVolumes-1114328522 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-466988020-445252442 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-466988020-445252442, it is now deprecated. Please use the default quota class for default quota. Jun 04 06:41:03 devstack cinder-volume[86069]: WARNING cinder.quota [None req-10bcdc34-2002-47c0-9c38-0a2f46dab243 tempest-TestInstancesWithCinderVolumes-1114328522 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-466988020-445252442 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-466988020-445252442, it is now deprecated. Please use the default quota class for default quota. Jun 04 06:41:03 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-10bcdc34-2002-47c0-9c38-0a2f46dab243 tempest-TestInstancesWithCinderVolumes-1114328522 None] Created reservations ['f4d501b6-ef3b-41ec-900d-c40e6583b630', '02002719-0b71-4e1a-b961-f69e7fbd3822', '727766a6-617d-47f5-a175-618bde807477', '6501d32f-67cd-4d6d-9d97-3ac3beaba36b'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:41:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-10bcdc34-2002-47c0-9c38-0a2f46dab243 tempest-TestInstancesWithCinderVolumes-1114328522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:41:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-10bcdc34-2002-47c0-9c38-0a2f46dab243 tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:41:03 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-10bcdc34-2002-47c0-9c38-0a2f46dab243 tempest-TestInstancesWithCinderVolumes-1114328522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:41:03 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-10bcdc34-2002-47c0-9c38-0a2f46dab243 tempest-TestInstancesWithCinderVolumes-1114328522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:41:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-10bcdc34-2002-47c0-9c38-0a2f46dab243 tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:41:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-10bcdc34-2002-47c0-9c38-0a2f46dab243 tempest-TestInstancesWithCinderVolumes-1114328522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:03 devstack sudo[101461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:41:03 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:04 devstack sudo[101458]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c8eb8fa9-aa87-4e87-889e-3df58872b47f tempest-VolumesActionsTest-1704680497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b26d8c4b-3de4-40ed-9b9e-389051d7d2f5" returned: 0 in 1.213s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c8eb8fa9-aa87-4e87-889e-3df58872b47f tempest-VolumesActionsTest-1704680497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b26d8c4b-3de4-40ed-9b9e-389051d7d2f5 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:04 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b26d8c4b-3de4-40ed-9b9e-389051d7d2f5 Jun 04 06:41:04 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:04 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-10bcdc34-2002-47c0-9c38-0a2f46dab243 tempest-TestInstancesWithCinderVolumes-1114328522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.049s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:04 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-10bcdc34-2002-47c0-9c38-0a2f46dab243 tempest-TestInstancesWithCinderVolumes-1114328522 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:41:04 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-10bcdc34-2002-47c0-9c38-0a2f46dab243 tempest-TestInstancesWithCinderVolumes-1114328522 None] Deleted volume successfully. Jun 04 06:41:04 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-10bcdc34-2002-47c0-9c38-0a2f46dab243 tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "cinder-c9aebd60-4028-4a2b-80b0-ac0072329627-delete_volume" released by "delete_volume" :: held 3.626s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:41:05 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c8eb8fa9-aa87-4e87-889e-3df58872b47f tempest-VolumesActionsTest-1704680497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b26d8c4b-3de4-40ed-9b9e-389051d7d2f5" returned: 0 in 0.838s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:05 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c8eb8fa9-aa87-4e87-889e-3df58872b47f tempest-VolumesActionsTest-1704680497 None] Lock "cinder-quobyte-b26d8c4b-3de4-40ed-9b9e-389051d7d2f5" released by "delete_volume" :: held 2.120s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:41:05 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-c8eb8fa9-aa87-4e87-889e-3df58872b47f tempest-VolumesActionsTest-1704680497 None] Created reservations ['75b5965f-e23e-40d8-ae9d-a80082836d70', 'c92d4132-5840-4dc3-83a3-fd48b3768071', 'f1204839-dcf8-4859-a805-d90d0c15b6e6', '8b658338-6f0b-4343-a82b-b91e61907806'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:41:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c8eb8fa9-aa87-4e87-889e-3df58872b47f tempest-VolumesActionsTest-1704680497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:41:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c8eb8fa9-aa87-4e87-889e-3df58872b47f tempest-VolumesActionsTest-1704680497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:41:05 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c8eb8fa9-aa87-4e87-889e-3df58872b47f tempest-VolumesActionsTest-1704680497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:41:05 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c8eb8fa9-aa87-4e87-889e-3df58872b47f tempest-VolumesActionsTest-1704680497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:41:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c8eb8fa9-aa87-4e87-889e-3df58872b47f tempest-VolumesActionsTest-1704680497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:41:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c8eb8fa9-aa87-4e87-889e-3df58872b47f tempest-VolumesActionsTest-1704680497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:05 devstack sudo[101473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:41:05 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:06 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c8eb8fa9-aa87-4e87-889e-3df58872b47f tempest-VolumesActionsTest-1704680497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.857s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:06 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-c8eb8fa9-aa87-4e87-889e-3df58872b47f tempest-VolumesActionsTest-1704680497 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:41:06 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-c8eb8fa9-aa87-4e87-889e-3df58872b47f tempest-VolumesActionsTest-1704680497 None] Deleted volume successfully. Jun 04 06:41:06 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c8eb8fa9-aa87-4e87-889e-3df58872b47f tempest-VolumesActionsTest-1704680497 None] Lock "cinder-b26d8c4b-3de4-40ed-9b9e-389051d7d2f5-delete_volume" released by "delete_volume" :: held 3.347s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:41:09 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-23e06902-6e1a-4089-951f-5f1d7c467643 req-f41e6637-c16f-4587-945d-068c0ca7bebf tempest-TestInstancesWithCinderVolumes-1114328522 None] Terminate volume connection completed successfully. Jun 04 06:41:09 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-23e06902-6e1a-4089-951f-5f1d7c467643 req-f41e6637-c16f-4587-945d-068c0ca7bebf tempest-TestInstancesWithCinderVolumes-1114328522 None] Deleting attachment d939fe24-3b88-4b7e-8326-7e0866c15365. {{(pid=86069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 06:41:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:41:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:41:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:41:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:41:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:41:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:41:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:11 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:41:11 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:11 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.596s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:11 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:41:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager._thread_info {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:41:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread count: 28 {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 06:41:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread info: [<_MainThread(MainThread, started 131797370544256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 06:41:12 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c5125fc7-4801-4d37-b1f7-105cb7f5df33 tempest-TestInstancesWithCinderVolumes-1114328522 None] Acquiring lock "cinder-7d96b2fa-7747-48d3-9976-dd1c30d264a4-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:41:12 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c5125fc7-4801-4d37-b1f7-105cb7f5df33 tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "cinder-7d96b2fa-7747-48d3-9976-dd1c30d264a4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:41:12 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c5125fc7-4801-4d37-b1f7-105cb7f5df33 tempest-TestInstancesWithCinderVolumes-1114328522 None] Acquiring lock "cinder-quobyte-7d96b2fa-7747-48d3-9976-dd1c30d264a4" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:41:12 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c5125fc7-4801-4d37-b1f7-105cb7f5df33 tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "cinder-quobyte-7d96b2fa-7747-48d3-9976-dd1c30d264a4" acquired by "delete_volume" :: waited 0.019s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:41:12 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce39fab-2787-4fb6-9636-4afd19dde938]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:41:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c5125fc7-4801-4d37-b1f7-105cb7f5df33 tempest-TestInstancesWithCinderVolumes-1114328522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:13 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4 Jun 04 06:41:13 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:13 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c5125fc7-4801-4d37-b1f7-105cb7f5df33 tempest-TestInstancesWithCinderVolumes-1114328522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4" returned: 0 in 0.738s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c5125fc7-4801-4d37-b1f7-105cb7f5df33 tempest-TestInstancesWithCinderVolumes-1114328522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:13 devstack sudo[101563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4 Jun 04 06:41:13 devstack sudo[101563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:14 devstack sudo[101563]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:14 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:41:14 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] Flow 'volume_create_manager' (20f657d9-0793-4b23-9a64-2fcd8f2d1650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:41:14 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5972ff0-273d-4f18-8021-5680ad069282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c5125fc7-4801-4d37-b1f7-105cb7f5df33 tempest-TestInstancesWithCinderVolumes-1114328522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4" returned: 1 in 0.900s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c5125fc7-4801-4d37-b1f7-105cb7f5df33 tempest-TestInstancesWithCinderVolumes-1114328522 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:41:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c5125fc7-4801-4d37-b1f7-105cb7f5df33 tempest-TestInstancesWithCinderVolumes-1114328522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:14 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5972ff0-273d-4f18-8021-5680ad069282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-788925905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc02a5d3-ff7f-4e16-8723-01eeb59f9c76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d12d7d55d1d403b9ac899abef7b66f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:41:15Z,use_quota=True,user_id='a1fb72527b334d2cb35f6faef9fca05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:14 devstack sudo[101569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4 Jun 04 06:41:14 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69f0af80-cc51-461e-96a1-2011932ddeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:14 devstack sudo[101569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:14 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69f0af80-cc51-461e-96a1-2011932ddeb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:14 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5474e308-47c8-4e52-85dc-50ff0676c74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:14 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5474e308-47c8-4e52-85dc-50ff0676c74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc02a5d3-ff7f-4e16-8723-01eeb59f9c76', 'volume_name': 'volume-dc02a5d3-ff7f-4e16-8723-01eeb59f9c76', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:14 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da972fdd-a1ef-4e96-9859-0a72bcb5cd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:14 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da972fdd-a1ef-4e96-9859-0a72bcb5cd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:14 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4843653c-28dd-42e0-b91a-a756ebdaad29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:14 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] Volume dc02a5d3-ff7f-4e16-8723-01eeb59f9c76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc02a5d3-ff7f-4e16-8723-01eeb59f9c76', 'volume_size': 1} Jun 04 06:41:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:41:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:41:14 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-788925905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc02a5d3-ff7f-4e16-8723-01eeb59f9c76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d12d7d55d1d403b9ac899abef7b66f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:41:15Z,use_quota=True,user_id='a1fb72527b334d2cb35f6faef9fca05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:41:14 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] Creating volume dc02a5d3-ff7f-4e16-8723-01eeb59f9c76 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:41:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:41:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:41:14 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:41:14 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:41:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:41:14 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:41:14 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:41:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dc02a5d3-ff7f-4e16-8723-01eeb59f9c76 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:14 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dc02a5d3-ff7f-4e16-8723-01eeb59f9c76 1073741824 Jun 04 06:41:14 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:15 devstack sudo[101569]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c5125fc7-4801-4d37-b1f7-105cb7f5df33 tempest-TestInstancesWithCinderVolumes-1114328522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7d96b2fa-7747-48d3-9976-dd1c30d264a4" returned: 0 in 0.619s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:15 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c5125fc7-4801-4d37-b1f7-105cb7f5df33 tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "cinder-quobyte-7d96b2fa-7747-48d3-9976-dd1c30d264a4" released by "delete_volume" :: held 2.335s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:41:15 devstack cinder-volume[86069]: WARNING cinder.quota [None req-c5125fc7-4801-4d37-b1f7-105cb7f5df33 tempest-TestInstancesWithCinderVolumes-1114328522 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-236668787-1515694195 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-236668787-1515694195, it is now deprecated. Please use the default quota class for default quota. Jun 04 06:41:15 devstack cinder-volume[86069]: WARNING cinder.quota [None req-c5125fc7-4801-4d37-b1f7-105cb7f5df33 tempest-TestInstancesWithCinderVolumes-1114328522 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-236668787-1515694195 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-236668787-1515694195, it is now deprecated. Please use the default quota class for default quota. Jun 04 06:41:15 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-c5125fc7-4801-4d37-b1f7-105cb7f5df33 tempest-TestInstancesWithCinderVolumes-1114328522 None] Created reservations ['a954f032-919f-4a0e-9a35-df5bb6e776c0', 'c98af033-2d29-4112-b94c-300d57c12c70', '23875bc3-7acd-47be-ac14-fce6948b785d', '43c57bbf-3bd5-49f8-b940-8a618efcaa7e'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:41:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c5125fc7-4801-4d37-b1f7-105cb7f5df33 tempest-TestInstancesWithCinderVolumes-1114328522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:41:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c5125fc7-4801-4d37-b1f7-105cb7f5df33 tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:41:15 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c5125fc7-4801-4d37-b1f7-105cb7f5df33 tempest-TestInstancesWithCinderVolumes-1114328522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:41:15 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c5125fc7-4801-4d37-b1f7-105cb7f5df33 tempest-TestInstancesWithCinderVolumes-1114328522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:41:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c5125fc7-4801-4d37-b1f7-105cb7f5df33 tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:41:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c5125fc7-4801-4d37-b1f7-105cb7f5df33 tempest-TestInstancesWithCinderVolumes-1114328522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:15 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:41:15 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:15 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dc02a5d3-ff7f-4e16-8723-01eeb59f9c76 1073741824" returned: 0 in 0.963s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dc02a5d3-ff7f-4e16-8723-01eeb59f9c76 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:15 devstack sudo[101580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dc02a5d3-ff7f-4e16-8723-01eeb59f9c76 Jun 04 06:41:15 devstack sudo[101580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:16 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c5125fc7-4801-4d37-b1f7-105cb7f5df33 tempest-TestInstancesWithCinderVolumes-1114328522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.635s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:16 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-c5125fc7-4801-4d37-b1f7-105cb7f5df33 tempest-TestInstancesWithCinderVolumes-1114328522 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:41:16 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-c5125fc7-4801-4d37-b1f7-105cb7f5df33 tempest-TestInstancesWithCinderVolumes-1114328522 None] Deleted volume successfully. Jun 04 06:41:16 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c5125fc7-4801-4d37-b1f7-105cb7f5df33 tempest-TestInstancesWithCinderVolumes-1114328522 None] Lock "cinder-7d96b2fa-7747-48d3-9976-dd1c30d264a4-delete_volume" released by "delete_volume" :: held 3.208s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:41:16 devstack sudo[101580]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dc02a5d3-ff7f-4e16-8723-01eeb59f9c76" returned: 0 in 0.731s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:16 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:41:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:41:16 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4843653c-28dd-42e0-b91a-a756ebdaad29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc02a5d3-ff7f-4e16-8723-01eeb59f9c76', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:16 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3a7b65-c93f-4bcd-a4d4-eb14d2f756a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:16 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] Volume volume-dc02a5d3-ff7f-4e16-8723-01eeb59f9c76 (dc02a5d3-ff7f-4e16-8723-01eeb59f9c76): created successfully Jun 04 06:41:16 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3a7b65-c93f-4bcd-a4d4-eb14d2f756a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:16 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] Flow 'volume_create_manager' (20f657d9-0793-4b23-9a64-2fcd8f2d1650) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:41:16 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-5647f2d4-5d70-41e4-ac97-32bebbfbfc6f tempest-VolumesActionsTest-1704680497 None] Created volume successfully. Jun 04 06:41:16 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-b8e6bb3f-75e7-42c4-8b66-06978dd37f20 tempest-VolumesActionsTest-137902531 None] Acquiring lock "cinder-dc02a5d3-ff7f-4e16-8723-01eeb59f9c76-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:41:16 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-b8e6bb3f-75e7-42c4-8b66-06978dd37f20 tempest-VolumesActionsTest-137902531 None] Lock "cinder-dc02a5d3-ff7f-4e16-8723-01eeb59f9c76-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:41:16 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-b8e6bb3f-75e7-42c4-8b66-06978dd37f20 tempest-VolumesActionsTest-137902531 None] Acquiring lock "cinder-quobyte-dc02a5d3-ff7f-4e16-8723-01eeb59f9c76" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:41:16 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-b8e6bb3f-75e7-42c4-8b66-06978dd37f20 tempest-VolumesActionsTest-137902531 None] Lock "cinder-quobyte-dc02a5d3-ff7f-4e16-8723-01eeb59f9c76" acquired by "delete_volume" :: waited 0.019s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:41:17 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8e1140-2046-4a09-b031-058e97778076]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:41:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b8e6bb3f-75e7-42c4-8b66-06978dd37f20 tempest-VolumesActionsTest-137902531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dc02a5d3-ff7f-4e16-8723-01eeb59f9c76 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:17 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dc02a5d3-ff7f-4e16-8723-01eeb59f9c76 Jun 04 06:41:17 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:17 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b8e6bb3f-75e7-42c4-8b66-06978dd37f20 tempest-VolumesActionsTest-137902531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dc02a5d3-ff7f-4e16-8723-01eeb59f9c76" returned: 0 in 0.745s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b8e6bb3f-75e7-42c4-8b66-06978dd37f20 tempest-VolumesActionsTest-137902531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dc02a5d3-ff7f-4e16-8723-01eeb59f9c76 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:17 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dc02a5d3-ff7f-4e16-8723-01eeb59f9c76 Jun 04 06:41:17 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:18 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b8e6bb3f-75e7-42c4-8b66-06978dd37f20 tempest-VolumesActionsTest-137902531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-dc02a5d3-ff7f-4e16-8723-01eeb59f9c76" returned: 0 in 0.642s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:18 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-b8e6bb3f-75e7-42c4-8b66-06978dd37f20 tempest-VolumesActionsTest-137902531 None] Lock "cinder-quobyte-dc02a5d3-ff7f-4e16-8723-01eeb59f9c76" released by "delete_volume" :: held 1.443s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:41:18 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-b8e6bb3f-75e7-42c4-8b66-06978dd37f20 tempest-VolumesActionsTest-137902531 None] Created reservations ['3577c655-5e99-410b-bbaf-edced253ab15', 'd4414f74-7b37-4dde-bff2-aad43010a4a7', 'ba43269f-c359-436f-8440-37683d5352b5', '80bc7387-b108-4ab5-b64a-f8c686faa4fb'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:41:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-b8e6bb3f-75e7-42c4-8b66-06978dd37f20 tempest-VolumesActionsTest-137902531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:41:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-b8e6bb3f-75e7-42c4-8b66-06978dd37f20 tempest-VolumesActionsTest-137902531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:41:18 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-b8e6bb3f-75e7-42c4-8b66-06978dd37f20 tempest-VolumesActionsTest-137902531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:41:18 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-b8e6bb3f-75e7-42c4-8b66-06978dd37f20 tempest-VolumesActionsTest-137902531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:41:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-b8e6bb3f-75e7-42c4-8b66-06978dd37f20 tempest-VolumesActionsTest-137902531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:41:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b8e6bb3f-75e7-42c4-8b66-06978dd37f20 tempest-VolumesActionsTest-137902531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:18 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:41:18 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:19 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b8e6bb3f-75e7-42c4-8b66-06978dd37f20 tempest-VolumesActionsTest-137902531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.681s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:19 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-b8e6bb3f-75e7-42c4-8b66-06978dd37f20 tempest-VolumesActionsTest-137902531 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:41:19 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-b8e6bb3f-75e7-42c4-8b66-06978dd37f20 tempest-VolumesActionsTest-137902531 None] Deleted volume successfully. Jun 04 06:41:19 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-b8e6bb3f-75e7-42c4-8b66-06978dd37f20 tempest-VolumesActionsTest-137902531 None] Lock "cinder-dc02a5d3-ff7f-4e16-8723-01eeb59f9c76-delete_volume" released by "delete_volume" :: held 2.388s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:41:19 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:41:19 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] Flow 'volume_create_manager' (dfc7c27c-9589-4b5a-ba34-96ed37def056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:41:19 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019381ee-170a-46db-a9cb-52a7a7fc18a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:19 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019381ee-170a-46db-a9cb-52a7a7fc18a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1784608912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a92305-1b4b-44c9-9ec4-a5efcb50bf17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d12d7d55d1d403b9ac899abef7b66f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:41:20Z,use_quota=True,user_id='a1fb72527b334d2cb35f6faef9fca05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:19 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abc62030-8c36-4d69-a385-0ea397f6bca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:19 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abc62030-8c36-4d69-a385-0ea397f6bca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:19 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc5101b-b8b8-4459-8108-3fcf2abfdd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:19 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc5101b-b8b8-4459-8108-3fcf2abfdd72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70a92305-1b4b-44c9-9ec4-a5efcb50bf17', 'volume_name': 'volume-70a92305-1b4b-44c9-9ec4-a5efcb50bf17', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:19 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e957eafb-a568-4b37-9ab4-f04ab5ff01f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:19 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e957eafb-a568-4b37-9ab4-f04ab5ff01f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:19 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b410eb8-f7d7-491d-ae5b-736f38e80d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:19 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] Volume 70a92305-1b4b-44c9-9ec4-a5efcb50bf17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70a92305-1b4b-44c9-9ec4-a5efcb50bf17', 'volume_size': 1} Jun 04 06:41:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:41:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:41:19 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1784608912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a92305-1b4b-44c9-9ec4-a5efcb50bf17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d12d7d55d1d403b9ac899abef7b66f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:41:20Z,use_quota=True,user_id='a1fb72527b334d2cb35f6faef9fca05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:41:19 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] Creating volume 70a92305-1b4b-44c9-9ec4-a5efcb50bf17 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:41:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:41:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:41:19 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:41:19 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:41:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:41:19 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:41:19 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:41:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-70a92305-1b4b-44c9-9ec4-a5efcb50bf17 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:19 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-70a92305-1b4b-44c9-9ec4-a5efcb50bf17 1073741824 Jun 04 06:41:19 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:20 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-70a92305-1b4b-44c9-9ec4-a5efcb50bf17 1073741824" returned: 0 in 0.871s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-70a92305-1b4b-44c9-9ec4-a5efcb50bf17 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:20 devstack sudo[101604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-70a92305-1b4b-44c9-9ec4-a5efcb50bf17 Jun 04 06:41:20 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:21 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-70a92305-1b4b-44c9-9ec4-a5efcb50bf17" returned: 0 in 0.632s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:21 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:41:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:41:21 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b410eb8-f7d7-491d-ae5b-736f38e80d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70a92305-1b4b-44c9-9ec4-a5efcb50bf17', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:21 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b27eaad-6f2a-4383-8180-c4c5eee665de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:21 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] Volume volume-70a92305-1b4b-44c9-9ec4-a5efcb50bf17 (70a92305-1b4b-44c9-9ec4-a5efcb50bf17): created successfully Jun 04 06:41:21 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b27eaad-6f2a-4383-8180-c4c5eee665de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:21 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] Flow 'volume_create_manager' (dfc7c27c-9589-4b5a-ba34-96ed37def056) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:41:21 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-8b93bbd2-92e3-47dd-9334-ecc02a3767a7 tempest-VolumesActionsTest-1704680497 None] Created volume successfully. Jun 04 06:41:21 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-b39778f0-710d-4c80-8705-79ab6235553d tempest-VolumesActionsTest-137902531 None] Acquiring lock "cinder-70a92305-1b4b-44c9-9ec4-a5efcb50bf17-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:41:21 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-b39778f0-710d-4c80-8705-79ab6235553d tempest-VolumesActionsTest-137902531 None] Lock "cinder-70a92305-1b4b-44c9-9ec4-a5efcb50bf17-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:41:22 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-b39778f0-710d-4c80-8705-79ab6235553d tempest-VolumesActionsTest-137902531 None] Acquiring lock "cinder-quobyte-70a92305-1b4b-44c9-9ec4-a5efcb50bf17" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:41:22 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-b39778f0-710d-4c80-8705-79ab6235553d tempest-VolumesActionsTest-137902531 None] Lock "cinder-quobyte-70a92305-1b4b-44c9-9ec4-a5efcb50bf17" acquired by "delete_volume" :: waited 0.016s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:41:22 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab4c3c9-cb39-407d-b30e-06dc442c1978]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:41:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b39778f0-710d-4c80-8705-79ab6235553d tempest-VolumesActionsTest-137902531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-70a92305-1b4b-44c9-9ec4-a5efcb50bf17 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:22 devstack sudo[101607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-70a92305-1b4b-44c9-9ec4-a5efcb50bf17 Jun 04 06:41:22 devstack sudo[101607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:22 devstack sudo[101607]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b39778f0-710d-4c80-8705-79ab6235553d tempest-VolumesActionsTest-137902531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-70a92305-1b4b-44c9-9ec4-a5efcb50bf17" returned: 0 in 0.800s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b39778f0-710d-4c80-8705-79ab6235553d tempest-VolumesActionsTest-137902531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-70a92305-1b4b-44c9-9ec4-a5efcb50bf17 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:22 devstack sudo[101614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-70a92305-1b4b-44c9-9ec4-a5efcb50bf17 Jun 04 06:41:22 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:23 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b39778f0-710d-4c80-8705-79ab6235553d tempest-VolumesActionsTest-137902531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-70a92305-1b4b-44c9-9ec4-a5efcb50bf17" returned: 0 in 0.624s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:23 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-b39778f0-710d-4c80-8705-79ab6235553d tempest-VolumesActionsTest-137902531 None] Lock "cinder-quobyte-70a92305-1b4b-44c9-9ec4-a5efcb50bf17" released by "delete_volume" :: held 1.466s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:41:23 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=52,cinder:UPDATE=61,cinder:INSERT=13,cinder:DELETE=5 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:41:23 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=57,cinder:UPDATE=51,cinder:INSERT=12,cinder:DELETE=3 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:41:23 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-b39778f0-710d-4c80-8705-79ab6235553d tempest-VolumesActionsTest-137902531 None] Created reservations ['d7310c7f-69a3-47bb-b97d-db9714936af9', '5ef9ec79-35cf-45fd-a348-6128e7ddd4d5', '83ef264f-f92c-4304-924d-65d9a0bca958', 'e421e51a-09cb-4c4d-a3c5-7967eaa56d73'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:41:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-b39778f0-710d-4c80-8705-79ab6235553d tempest-VolumesActionsTest-137902531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:41:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-b39778f0-710d-4c80-8705-79ab6235553d tempest-VolumesActionsTest-137902531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:41:23 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-b39778f0-710d-4c80-8705-79ab6235553d tempest-VolumesActionsTest-137902531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:41:23 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-b39778f0-710d-4c80-8705-79ab6235553d tempest-VolumesActionsTest-137902531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:41:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-b39778f0-710d-4c80-8705-79ab6235553d tempest-VolumesActionsTest-137902531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:41:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b39778f0-710d-4c80-8705-79ab6235553d tempest-VolumesActionsTest-137902531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:23 devstack sudo[101617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:41:23 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:24 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b39778f0-710d-4c80-8705-79ab6235553d tempest-VolumesActionsTest-137902531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.679s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:24 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-b39778f0-710d-4c80-8705-79ab6235553d tempest-VolumesActionsTest-137902531 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:41:24 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-b39778f0-710d-4c80-8705-79ab6235553d tempest-VolumesActionsTest-137902531 None] Deleted volume successfully. Jun 04 06:41:24 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-b39778f0-710d-4c80-8705-79ab6235553d tempest-VolumesActionsTest-137902531 None] Lock "cinder-70a92305-1b4b-44c9-9ec4-a5efcb50bf17-delete_volume" released by "delete_volume" :: held 2.401s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:41:24 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:41:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] Flow 'volume_create_manager' (eea9c566-e696-43c2-82b9-3dcf4066de95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:41:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135bd31f-22aa-4a8b-a045-2c19360ee0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135bd31f-22aa-4a8b-a045-2c19360ee0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1313798808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fb3915f-89ea-4062-a2ba-39ea28d08961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d12d7d55d1d403b9ac899abef7b66f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:41:25Z,use_quota=True,user_id='a1fb72527b334d2cb35f6faef9fca05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b7707b-a3c7-4714-ab72-6f53b514b0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b7707b-a3c7-4714-ab72-6f53b514b0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72745835-5e01-4fa6-8d50-5840f54f0a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72745835-5e01-4fa6-8d50-5840f54f0a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fb3915f-89ea-4062-a2ba-39ea28d08961', 'volume_name': 'volume-7fb3915f-89ea-4062-a2ba-39ea28d08961', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b321ab4b-074d-4ec5-8f04-c4da53b66d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b321ab4b-074d-4ec5-8f04-c4da53b66d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f833744-f9d1-4928-9a38-80eca5e4aecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:24 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] Volume 7fb3915f-89ea-4062-a2ba-39ea28d08961: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fb3915f-89ea-4062-a2ba-39ea28d08961', 'volume_size': 1} Jun 04 06:41:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:41:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:41:24 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1313798808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fb3915f-89ea-4062-a2ba-39ea28d08961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d12d7d55d1d403b9ac899abef7b66f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:41:25Z,use_quota=True,user_id='a1fb72527b334d2cb35f6faef9fca05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:41:24 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] Creating volume 7fb3915f-89ea-4062-a2ba-39ea28d08961 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:41:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:41:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:41:24 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:41:24 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:41:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:41:24 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:41:24 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:41:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7fb3915f-89ea-4062-a2ba-39ea28d08961 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:24 devstack sudo[101621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7fb3915f-89ea-4062-a2ba-39ea28d08961 1073741824 Jun 04 06:41:24 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:25 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7fb3915f-89ea-4062-a2ba-39ea28d08961 1073741824" returned: 0 in 0.904s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7fb3915f-89ea-4062-a2ba-39ea28d08961 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:25 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7fb3915f-89ea-4062-a2ba-39ea28d08961 Jun 04 06:41:25 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:26 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7fb3915f-89ea-4062-a2ba-39ea28d08961" returned: 0 in 0.648s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:26 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:41:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:41:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f833744-f9d1-4928-9a38-80eca5e4aecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fb3915f-89ea-4062-a2ba-39ea28d08961', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3774bc1d-4908-40b4-82a9-2ae7dd6fbc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:26 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] Volume volume-7fb3915f-89ea-4062-a2ba-39ea28d08961 (7fb3915f-89ea-4062-a2ba-39ea28d08961): created successfully Jun 04 06:41:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3774bc1d-4908-40b4-82a9-2ae7dd6fbc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] Flow 'volume_create_manager' (eea9c566-e696-43c2-82b9-3dcf4066de95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:41:26 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-202528ce-a0c7-4304-bd57-cb4d0bc25dd1 tempest-VolumesActionsTest-1704680497 None] Created volume successfully. Jun 04 06:41:26 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-cc1f1992-e369-4562-b3e9-cfe331fa495c tempest-VolumesActionsTest-137902531 None] Acquiring lock "cinder-7fb3915f-89ea-4062-a2ba-39ea28d08961-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:41:26 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-cc1f1992-e369-4562-b3e9-cfe331fa495c tempest-VolumesActionsTest-137902531 None] Lock "cinder-7fb3915f-89ea-4062-a2ba-39ea28d08961-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:41:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-cc1f1992-e369-4562-b3e9-cfe331fa495c tempest-VolumesActionsTest-137902531 None] Acquiring lock "cinder-quobyte-7fb3915f-89ea-4062-a2ba-39ea28d08961" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:41:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-cc1f1992-e369-4562-b3e9-cfe331fa495c tempest-VolumesActionsTest-137902531 None] Lock "cinder-quobyte-7fb3915f-89ea-4062-a2ba-39ea28d08961" acquired by "delete_volume" :: waited 0.016s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:41:27 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[1375f64f-2d24-4c31-92dd-d2a729870612]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:41:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-cc1f1992-e369-4562-b3e9-cfe331fa495c tempest-VolumesActionsTest-137902531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7fb3915f-89ea-4062-a2ba-39ea28d08961 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:27 devstack sudo[101631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7fb3915f-89ea-4062-a2ba-39ea28d08961 Jun 04 06:41:27 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:27 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-cc1f1992-e369-4562-b3e9-cfe331fa495c tempest-VolumesActionsTest-137902531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7fb3915f-89ea-4062-a2ba-39ea28d08961" returned: 0 in 0.727s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-cc1f1992-e369-4562-b3e9-cfe331fa495c tempest-VolumesActionsTest-137902531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7fb3915f-89ea-4062-a2ba-39ea28d08961 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:27 devstack sudo[101636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7fb3915f-89ea-4062-a2ba-39ea28d08961 Jun 04 06:41:27 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:28 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-cc1f1992-e369-4562-b3e9-cfe331fa495c tempest-VolumesActionsTest-137902531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7fb3915f-89ea-4062-a2ba-39ea28d08961" returned: 0 in 0.597s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:28 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-cc1f1992-e369-4562-b3e9-cfe331fa495c tempest-VolumesActionsTest-137902531 None] Lock "cinder-quobyte-7fb3915f-89ea-4062-a2ba-39ea28d08961" released by "delete_volume" :: held 1.369s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:41:28 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-cc1f1992-e369-4562-b3e9-cfe331fa495c tempest-VolumesActionsTest-137902531 None] Created reservations ['93a14ebf-93cf-4ccf-82d0-bf66ad270d07', '6d3421f6-a9ae-4582-be20-dd1b25ca3855', '5dc9d0c5-b2b2-40af-8bc7-77a53e3bfaed', '19c57889-a49d-4a7d-ba3d-64173dac6145'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:41:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-cc1f1992-e369-4562-b3e9-cfe331fa495c tempest-VolumesActionsTest-137902531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:41:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-cc1f1992-e369-4562-b3e9-cfe331fa495c tempest-VolumesActionsTest-137902531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:41:28 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-cc1f1992-e369-4562-b3e9-cfe331fa495c tempest-VolumesActionsTest-137902531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:41:28 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-cc1f1992-e369-4562-b3e9-cfe331fa495c tempest-VolumesActionsTest-137902531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:41:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-cc1f1992-e369-4562-b3e9-cfe331fa495c tempest-VolumesActionsTest-137902531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:41:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-cc1f1992-e369-4562-b3e9-cfe331fa495c tempest-VolumesActionsTest-137902531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:28 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:41:28 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:29 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-cc1f1992-e369-4562-b3e9-cfe331fa495c tempest-VolumesActionsTest-137902531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.656s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:29 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-cc1f1992-e369-4562-b3e9-cfe331fa495c tempest-VolumesActionsTest-137902531 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:41:29 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-cc1f1992-e369-4562-b3e9-cfe331fa495c tempest-VolumesActionsTest-137902531 None] Deleted volume successfully. Jun 04 06:41:29 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-cc1f1992-e369-4562-b3e9-cfe331fa495c tempest-VolumesActionsTest-137902531 None] Lock "cinder-7fb3915f-89ea-4062-a2ba-39ea28d08961-delete_volume" released by "delete_volume" :: held 2.258s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:41:29 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:41:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] Flow 'volume_create_manager' (e28bada2-853c-4f62-ac99-8afea6f70d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:41:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea0763b-3a18-429d-be94-d694d4358964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea0763b-3a18-429d-be94-d694d4358964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-696474736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=395c1e9b-3164-4b0b-96fe-1e2acc3300f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d12d7d55d1d403b9ac899abef7b66f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:41:30Z,use_quota=True,user_id='a1fb72527b334d2cb35f6faef9fca05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a2b35e-862e-496a-99d9-a2b7ad570016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a2b35e-862e-496a-99d9-a2b7ad570016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf2b43f3-94f2-470f-9beb-d31def34404e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf2b43f3-94f2-470f-9beb-d31def34404e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '395c1e9b-3164-4b0b-96fe-1e2acc3300f1', 'volume_name': 'volume-395c1e9b-3164-4b0b-96fe-1e2acc3300f1', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca671907-f0d1-49fd-ba34-eb0a3517c3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca671907-f0d1-49fd-ba34-eb0a3517c3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (326a7d11-ca43-4541-984d-bf4a29794973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:29 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] Volume 395c1e9b-3164-4b0b-96fe-1e2acc3300f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-395c1e9b-3164-4b0b-96fe-1e2acc3300f1', 'volume_size': 1} Jun 04 06:41:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:41:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:41:29 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-696474736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=395c1e9b-3164-4b0b-96fe-1e2acc3300f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d12d7d55d1d403b9ac899abef7b66f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:41:30Z,use_quota=True,user_id='a1fb72527b334d2cb35f6faef9fca05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:41:29 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] Creating volume 395c1e9b-3164-4b0b-96fe-1e2acc3300f1 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:41:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:41:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:41:29 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:41:29 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:41:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:41:29 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:41:29 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:41:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-395c1e9b-3164-4b0b-96fe-1e2acc3300f1 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:29 devstack sudo[101642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-395c1e9b-3164-4b0b-96fe-1e2acc3300f1 1073741824 Jun 04 06:41:29 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:30 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-395c1e9b-3164-4b0b-96fe-1e2acc3300f1 1073741824" returned: 0 in 0.980s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-395c1e9b-3164-4b0b-96fe-1e2acc3300f1 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:30 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-395c1e9b-3164-4b0b-96fe-1e2acc3300f1 Jun 04 06:41:30 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:31 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-395c1e9b-3164-4b0b-96fe-1e2acc3300f1" returned: 0 in 0.631s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:31 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:41:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:41:31 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (326a7d11-ca43-4541-984d-bf4a29794973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-395c1e9b-3164-4b0b-96fe-1e2acc3300f1', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:31 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a8f1ff3-a1f4-49d2-ba81-36b6bd7caf4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:31 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] Volume volume-395c1e9b-3164-4b0b-96fe-1e2acc3300f1 (395c1e9b-3164-4b0b-96fe-1e2acc3300f1): created successfully Jun 04 06:41:31 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a8f1ff3-a1f4-49d2-ba81-36b6bd7caf4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:31 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] Flow 'volume_create_manager' (e28bada2-853c-4f62-ac99-8afea6f70d15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:41:31 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-c1589a84-c83f-4cac-9988-9a2aefe04ce8 tempest-VolumesActionsTest-1704680497 None] Created volume successfully. Jun 04 06:41:32 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-5fa369d9-0e96-4d22-9ce9-2bbd57f26714 tempest-VolumesActionsTest-137902531 None] Acquiring lock "cinder-395c1e9b-3164-4b0b-96fe-1e2acc3300f1-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:41:32 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-5fa369d9-0e96-4d22-9ce9-2bbd57f26714 tempest-VolumesActionsTest-137902531 None] Lock "cinder-395c1e9b-3164-4b0b-96fe-1e2acc3300f1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:41:32 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-5fa369d9-0e96-4d22-9ce9-2bbd57f26714 tempest-VolumesActionsTest-137902531 None] Acquiring lock "cinder-quobyte-395c1e9b-3164-4b0b-96fe-1e2acc3300f1" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:41:32 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-5fa369d9-0e96-4d22-9ce9-2bbd57f26714 tempest-VolumesActionsTest-137902531 None] Lock "cinder-quobyte-395c1e9b-3164-4b0b-96fe-1e2acc3300f1" acquired by "delete_volume" :: waited 0.029s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:41:32 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[367c13eb-6b18-4e3f-8dbf-0ade644594a4]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:41:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5fa369d9-0e96-4d22-9ce9-2bbd57f26714 tempest-VolumesActionsTest-137902531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-395c1e9b-3164-4b0b-96fe-1e2acc3300f1 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:32 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-395c1e9b-3164-4b0b-96fe-1e2acc3300f1 Jun 04 06:41:32 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:33 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5fa369d9-0e96-4d22-9ce9-2bbd57f26714 tempest-VolumesActionsTest-137902531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-395c1e9b-3164-4b0b-96fe-1e2acc3300f1" returned: 0 in 0.851s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5fa369d9-0e96-4d22-9ce9-2bbd57f26714 tempest-VolumesActionsTest-137902531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-395c1e9b-3164-4b0b-96fe-1e2acc3300f1 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:33 devstack sudo[101692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-395c1e9b-3164-4b0b-96fe-1e2acc3300f1 Jun 04 06:41:33 devstack sudo[101692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:33 devstack sudo[101692]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5fa369d9-0e96-4d22-9ce9-2bbd57f26714 tempest-VolumesActionsTest-137902531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-395c1e9b-3164-4b0b-96fe-1e2acc3300f1" returned: 0 in 0.762s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-5fa369d9-0e96-4d22-9ce9-2bbd57f26714 tempest-VolumesActionsTest-137902531 None] Lock "cinder-quobyte-395c1e9b-3164-4b0b-96fe-1e2acc3300f1" released by "delete_volume" :: held 1.758s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:41:33 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-5fa369d9-0e96-4d22-9ce9-2bbd57f26714 tempest-VolumesActionsTest-137902531 None] Created reservations ['67fcfe6b-b97f-41bd-a235-3b66511985b4', '92f24830-a380-4596-8e04-a722ffaebc40', '87a34e2b-deb8-425d-b849-b9fa6d4a399f', 'abc0a449-9066-4dca-9c8c-ab433f9ea320'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:41:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5fa369d9-0e96-4d22-9ce9-2bbd57f26714 tempest-VolumesActionsTest-137902531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:41:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5fa369d9-0e96-4d22-9ce9-2bbd57f26714 tempest-VolumesActionsTest-137902531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:41:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5fa369d9-0e96-4d22-9ce9-2bbd57f26714 tempest-VolumesActionsTest-137902531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:41:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5fa369d9-0e96-4d22-9ce9-2bbd57f26714 tempest-VolumesActionsTest-137902531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:41:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5fa369d9-0e96-4d22-9ce9-2bbd57f26714 tempest-VolumesActionsTest-137902531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:41:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5fa369d9-0e96-4d22-9ce9-2bbd57f26714 tempest-VolumesActionsTest-137902531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:34 devstack sudo[101695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:41:34 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:34 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5fa369d9-0e96-4d22-9ce9-2bbd57f26714 tempest-VolumesActionsTest-137902531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.838s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:34 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-5fa369d9-0e96-4d22-9ce9-2bbd57f26714 tempest-VolumesActionsTest-137902531 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:41:34 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-5fa369d9-0e96-4d22-9ce9-2bbd57f26714 tempest-VolumesActionsTest-137902531 None] Deleted volume successfully. Jun 04 06:41:34 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:41:34 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] Flow 'volume_create_manager' (e4c55c17-cd3b-459f-b52b-9a8338353d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:41:34 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e4c62fb-d0dd-49da-8de4-dae93931339f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-5fa369d9-0e96-4d22-9ce9-2bbd57f26714 tempest-VolumesActionsTest-137902531 None] Lock "cinder-395c1e9b-3164-4b0b-96fe-1e2acc3300f1-delete_volume" released by "delete_volume" :: held 2.921s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:41:34 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e4c62fb-d0dd-49da-8de4-dae93931339f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1060977172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcdfc8dd-6019-4511-9d44-848ee333f6cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d12d7d55d1d403b9ac899abef7b66f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:41:35Z,use_quota=True,user_id='a1fb72527b334d2cb35f6faef9fca05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:34 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3ee0c9f-8c04-4161-92a1-c4a4ea8d9e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:34 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3ee0c9f-8c04-4161-92a1-c4a4ea8d9e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:34 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff9c6214-44a7-4ecc-881e-409f947403ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:35 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff9c6214-44a7-4ecc-881e-409f947403ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcdfc8dd-6019-4511-9d44-848ee333f6cc', 'volume_name': 'volume-fcdfc8dd-6019-4511-9d44-848ee333f6cc', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:35 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aafdc288-ff6c-45b2-8e9a-ccecf10042ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:35 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aafdc288-ff6c-45b2-8e9a-ccecf10042ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:35 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95801071-57d1-4214-968a-dc41b281557c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:35 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] Volume fcdfc8dd-6019-4511-9d44-848ee333f6cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcdfc8dd-6019-4511-9d44-848ee333f6cc', 'volume_size': 1} Jun 04 06:41:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:41:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:41:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1060977172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcdfc8dd-6019-4511-9d44-848ee333f6cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d12d7d55d1d403b9ac899abef7b66f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:41:35Z,use_quota=True,user_id='a1fb72527b334d2cb35f6faef9fca05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:41:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] Creating volume fcdfc8dd-6019-4511-9d44-848ee333f6cc {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:41:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:41:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:41:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:41:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:41:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:41:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:41:35 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:41:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fcdfc8dd-6019-4511-9d44-848ee333f6cc 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:35 devstack sudo[101704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fcdfc8dd-6019-4511-9d44-848ee333f6cc 1073741824 Jun 04 06:41:35 devstack sudo[101704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:35 devstack sudo[101704]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fcdfc8dd-6019-4511-9d44-848ee333f6cc 1073741824" returned: 0 in 0.928s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fcdfc8dd-6019-4511-9d44-848ee333f6cc {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:36 devstack sudo[101709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fcdfc8dd-6019-4511-9d44-848ee333f6cc Jun 04 06:41:36 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:36 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fcdfc8dd-6019-4511-9d44-848ee333f6cc" returned: 0 in 0.699s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:36 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:41:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:41:36 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95801071-57d1-4214-968a-dc41b281557c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcdfc8dd-6019-4511-9d44-848ee333f6cc', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:36 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69e8fcb0-9fe7-4007-8add-0a66f7d2bef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:36 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] Volume volume-fcdfc8dd-6019-4511-9d44-848ee333f6cc (fcdfc8dd-6019-4511-9d44-848ee333f6cc): created successfully Jun 04 06:41:36 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69e8fcb0-9fe7-4007-8add-0a66f7d2bef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:36 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] Flow 'volume_create_manager' (e4c55c17-cd3b-459f-b52b-9a8338353d88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:41:36 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-47388ca8-9927-47dd-9378-caf8447d6ba3 tempest-VolumesActionsTest-1704680497 None] Created volume successfully. Jun 04 06:41:37 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6017c2ad-276c-4f27-90ad-9311947cf0df tempest-VolumesActionsTest-1704680497 None] Acquiring lock "cinder-fcdfc8dd-6019-4511-9d44-848ee333f6cc-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:41:37 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6017c2ad-276c-4f27-90ad-9311947cf0df tempest-VolumesActionsTest-1704680497 None] Lock "cinder-fcdfc8dd-6019-4511-9d44-848ee333f6cc-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:41:37 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6017c2ad-276c-4f27-90ad-9311947cf0df tempest-VolumesActionsTest-1704680497 None] Acquiring lock "cinder-quobyte-fcdfc8dd-6019-4511-9d44-848ee333f6cc" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:41:37 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6017c2ad-276c-4f27-90ad-9311947cf0df tempest-VolumesActionsTest-1704680497 None] Lock "cinder-quobyte-fcdfc8dd-6019-4511-9d44-848ee333f6cc" acquired by "delete_volume" :: waited 0.016s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:41:37 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b912a8-055d-4e3e-ba88-7a262f11d2c5]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:41:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6017c2ad-276c-4f27-90ad-9311947cf0df tempest-VolumesActionsTest-1704680497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fcdfc8dd-6019-4511-9d44-848ee333f6cc {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:37 devstack sudo[101713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fcdfc8dd-6019-4511-9d44-848ee333f6cc Jun 04 06:41:37 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:38 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6017c2ad-276c-4f27-90ad-9311947cf0df tempest-VolumesActionsTest-1704680497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fcdfc8dd-6019-4511-9d44-848ee333f6cc" returned: 0 in 0.836s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6017c2ad-276c-4f27-90ad-9311947cf0df tempest-VolumesActionsTest-1704680497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fcdfc8dd-6019-4511-9d44-848ee333f6cc {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:38 devstack sudo[101718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fcdfc8dd-6019-4511-9d44-848ee333f6cc Jun 04 06:41:38 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:39 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6017c2ad-276c-4f27-90ad-9311947cf0df tempest-VolumesActionsTest-1704680497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fcdfc8dd-6019-4511-9d44-848ee333f6cc" returned: 0 in 0.662s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6017c2ad-276c-4f27-90ad-9311947cf0df tempest-VolumesActionsTest-1704680497 None] Lock "cinder-quobyte-fcdfc8dd-6019-4511-9d44-848ee333f6cc" released by "delete_volume" :: held 1.550s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:41:39 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-6017c2ad-276c-4f27-90ad-9311947cf0df tempest-VolumesActionsTest-1704680497 None] Created reservations ['5a52dac3-a986-49d9-882f-d42549fb2b35', 'cc04dc35-4351-4a45-a581-2af091a98187', 'fcbc52d2-7d61-42da-a75a-7d1e056a0743', '1ffc70ca-5d0a-4c6b-a10a-7440f4929cbe'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:41:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-6017c2ad-276c-4f27-90ad-9311947cf0df tempest-VolumesActionsTest-1704680497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:41:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-6017c2ad-276c-4f27-90ad-9311947cf0df tempest-VolumesActionsTest-1704680497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:41:39 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-6017c2ad-276c-4f27-90ad-9311947cf0df tempest-VolumesActionsTest-1704680497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:41:39 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-6017c2ad-276c-4f27-90ad-9311947cf0df tempest-VolumesActionsTest-1704680497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:41:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-6017c2ad-276c-4f27-90ad-9311947cf0df tempest-VolumesActionsTest-1704680497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:41:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6017c2ad-276c-4f27-90ad-9311947cf0df tempest-VolumesActionsTest-1704680497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:39 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:41:39 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:40 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6017c2ad-276c-4f27-90ad-9311947cf0df tempest-VolumesActionsTest-1704680497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.682s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:40 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-6017c2ad-276c-4f27-90ad-9311947cf0df tempest-VolumesActionsTest-1704680497 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:41:40 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-6017c2ad-276c-4f27-90ad-9311947cf0df tempest-VolumesActionsTest-1704680497 None] Deleted volume successfully. Jun 04 06:41:40 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6017c2ad-276c-4f27-90ad-9311947cf0df tempest-VolumesActionsTest-1704680497 None] Lock "cinder-fcdfc8dd-6019-4511-9d44-848ee333f6cc-delete_volume" released by "delete_volume" :: held 2.458s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:41:49 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:41:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Flow 'volume_create_manager' (7b9fafaf-3014-4fb4-8d8e-d8e63fcd84c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:41:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d17c57c-62be-4c7c-a79a-b819f02923c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d17c57c-62be-4c7c-a79a-b819f02923c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-448610040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759dbd11-8266-4e77-b683-fe3930fb8389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c643fc0f3a914a35b2e04b16a2237207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:41:49Z,use_quota=True,user_id='83d8074dbc78486e9247bfcdc0d300be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a43518-26ab-4531-a5b2-6987fe6508f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a43518-26ab-4531-a5b2-6987fe6508f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d19686-b004-464a-884f-cd530869c037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:49 devstack cinder-volume[86069]: DEBUG cinder.image.glance [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Creating Keystone auth plugin from conf {{(pid=86069) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 04 06:41:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d19686-b004-464a-884f-cd530869c037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '759dbd11-8266-4e77-b683-fe3930fb8389', 'volume_name': 'volume-759dbd11-8266-4e77-b683-fe3930fb8389', 'volume_size': 1, 'image_id': '356a113c-ac9f-4c32-896c-2ab17fc4b371', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/356a113c-ac9f-4c32-896c-2ab17fc4b371', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73b4c085134a4115abd513b2dd9d6c91', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '356a113c-ac9f-4c32-896c-2ab17fc4b371', 'created_at': datetime.datetime(2026, 6, 4, 4, 19, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 4, 19, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/356a113c-ac9f-4c32-896c-2ab17fc4b371/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c86d775a-39a0-4b92-a0d0-85dd4daab6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c86d775a-39a0-4b92-a0d0-85dd4daab6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd34209-9f26-4026-a581-2ad884821539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:49 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Volume 759dbd11-8266-4e77-b683-fe3930fb8389: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-759dbd11-8266-4e77-b683-fe3930fb8389', 'volume_size': 1, 'image_id': '356a113c-ac9f-4c32-896c-2ab17fc4b371', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/356a113c-ac9f-4c32-896c-2ab17fc4b371', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73b4c085134a4115abd513b2dd9d6c91', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '356a113c-ac9f-4c32-896c-2ab17fc4b371', 'created_at': datetime.datetime(2026, 6, 4, 4, 19, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 4, 19, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/356a113c-ac9f-4c32-896c-2ab17fc4b371/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 04 06:41:49 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Trying to clone 759dbd11-8266-4e77-b683-fe3930fb8389 from image 356a113c-ac9f-4c32-896c-2ab17fc4b371 at location (None, [{'url': 'file:///opt/stack/data/glance/images/356a113c-ac9f-4c32-896c-2ab17fc4b371', 'metadata': {}}]). {{(pid=86069) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 04 06:41:50 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_kqb1idsldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86069) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 04 06:41:50 devstack cinder-volume[86069]: INFO cinder.image.image_utils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Image download 20.69 MB at 20.69 MB/s Jun 04 06:41:50 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f385d454-11fd-44d4-bf24-c373467fada1]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:41:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_kqb1idsldevstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:50 devstack sudo[101729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_kqb1idsldevstack@QuobyteHD Jun 04 06:41:50 devstack sudo[101729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:50 devstack sudo[101729]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_kqb1idsldevstack@QuobyteHD" returned: 0 in 0.785s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:50 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Temporary image 356a113c-ac9f-4c32-896c-2ab17fc4b371 is fetched for user 83d8074dbc78486e9247bfcdc0d300be. {{(pid=86069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 04 06:41:50 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bf091a-67dc-48f2-a93d-53be3ee04085]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:41:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_kqb1idsldevstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:51 devstack sudo[101734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_kqb1idsldevstack@QuobyteHD Jun 04 06:41:51 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:51 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_kqb1idsldevstack@QuobyteHD" returned: 0 in 0.705s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:41:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:41:51 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-448610040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759dbd11-8266-4e77-b683-fe3930fb8389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c643fc0f3a914a35b2e04b16a2237207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:41:49Z,use_quota=True,user_id='83d8074dbc78486e9247bfcdc0d300be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:41:51 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Creating volume 759dbd11-8266-4e77-b683-fe3930fb8389 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:41:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:41:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:41:51 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:41:51 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:41:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:41:51 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:41:51 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:41:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:51 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389 1073741824 Jun 04 06:41:51 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:52 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389 1073741824" returned: 0 in 0.888s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:52 devstack sudo[101747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389 Jun 04 06:41:52 devstack sudo[101747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:53 devstack sudo[101747]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389" returned: 0 in 0.639s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:53 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:41:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:41:53 devstack cinder-volume[86069]: DEBUG cinder.volume.volume_utils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Attempting download of 356a113c-ac9f-4c32-896c-2ab17fc4b371 ((None, [{'url': 'file:///opt/stack/data/glance/images/356a113c-ac9f-4c32-896c-2ab17fc4b371', 'metadata': {}}])) to volume 759dbd11-8266-4e77-b683-fe3930fb8389. {{(pid=86069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 04 06:41:53 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cb75ef-0d21-4278-92a7-269d041267b6]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:41:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_356a113c-ac9f-4c32-896c-2ab17fc4b371_8n3xgwpq {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:53 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_356a113c-ac9f-4c32-896c-2ab17fc4b371_8n3xgwpq Jun 04 06:41:53 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:54 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_356a113c-ac9f-4c32-896c-2ab17fc4b371_8n3xgwpq" returned: 0 in 0.720s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_356a113c-ac9f-4c32-896c-2ab17fc4b371_8n3xgwpq {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:54 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_356a113c-ac9f-4c32-896c-2ab17fc4b371_8n3xgwpq Jun 04 06:41:54 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:54 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_356a113c-ac9f-4c32-896c-2ab17fc4b371_8n3xgwpq" returned: 1 in 0.687s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_356a113c-ac9f-4c32-896c-2ab17fc4b371_8n3xgwpq' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:41:54 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c9f320-9c4c-42bc-bc15-d3db9dee8058]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:41:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_kqb1idsldevstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:54 devstack sudo[101760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_kqb1idsldevstack@QuobyteHD Jun 04 06:41:54 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:55 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_kqb1idsldevstack@QuobyteHD" returned: 0 in 0.662s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:55 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] 356a113c-ac9f-4c32-896c-2ab17fc4b371 was qcow2, converting to raw {{(pid=86069) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 04 06:41:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_kqb1idsldevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:55 devstack sudo[101765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_kqb1idsldevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389 Jun 04 06:41:55 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:55 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:41:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] Flow 'volume_create_manager' (5cfe5490-43e6-4f73-9c21-728066e13b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:41:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (750ec15a-540a-4d4f-aa7b-3cf412e0f19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (750ec15a-540a-4d4f-aa7b-3cf412e0f19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-533783120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=908cad2f-748b-4838-b25c-f9d4e0ec5008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e02416adfbb94c59b9ff6b7862493523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:41:56Z,use_quota=True,user_id='ffcd800ce1d345d48e69468d21be2168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (901562f4-5646-4698-a172-bd5b7553415a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (901562f4-5646-4698-a172-bd5b7553415a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a63d17ab-016e-4c98-a8fd-e4fdcc0ff770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a63d17ab-016e-4c98-a8fd-e4fdcc0ff770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '908cad2f-748b-4838-b25c-f9d4e0ec5008', 'volume_name': 'volume-908cad2f-748b-4838-b25c-f9d4e0ec5008', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9b7cf5d-b6a7-456f-a0bc-049462ca55ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9b7cf5d-b6a7-456f-a0bc-049462ca55ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52eae511-66ab-4d2b-9738-bb7c0e0017f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:55 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] Volume 908cad2f-748b-4838-b25c-f9d4e0ec5008: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-908cad2f-748b-4838-b25c-f9d4e0ec5008', 'volume_size': 1} Jun 04 06:41:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:41:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:41:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-533783120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=908cad2f-748b-4838-b25c-f9d4e0ec5008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e02416adfbb94c59b9ff6b7862493523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:41:56Z,use_quota=True,user_id='ffcd800ce1d345d48e69468d21be2168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:41:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] Creating volume 908cad2f-748b-4838-b25c-f9d4e0ec5008 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:41:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:41:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:41:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:41:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:41:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:41:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:41:55 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:41:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-908cad2f-748b-4838-b25c-f9d4e0ec5008 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:55 devstack sudo[101767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-908cad2f-748b-4838-b25c-f9d4e0ec5008 1073741824 Jun 04 06:41:55 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:56 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-908cad2f-748b-4838-b25c-f9d4e0ec5008 1073741824" returned: 0 in 0.889s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-908cad2f-748b-4838-b25c-f9d4e0ec5008 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:56 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-908cad2f-748b-4838-b25c-f9d4e0ec5008 Jun 04 06:41:56 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:57 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_kqb1idsldevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389" returned: 0 in 2.047s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:57 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_356a113c-ac9f-4c32-896c-2ab17fc4b371_kqb1idsldevstack@QuobyteHD, size 112.00 MB, duration 2.05 sec, destination /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389 {{(pid=86069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 06:41:57 devstack cinder-volume[86069]: INFO cinder.image.image_utils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Converted 112.00 MB image at 54.68 MB/s Jun 04 06:41:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:57 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-908cad2f-748b-4838-b25c-f9d4e0ec5008" returned: 0 in 0.624s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:57 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:41:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:41:57 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389 1G Jun 04 06:41:57 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52eae511-66ab-4d2b-9738-bb7c0e0017f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-908cad2f-748b-4838-b25c-f9d4e0ec5008', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b0b9aaa-7ce2-4351-8a84-feca0cd5a651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:57 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] Volume volume-908cad2f-748b-4838-b25c-f9d4e0ec5008 (908cad2f-748b-4838-b25c-f9d4e0ec5008): created successfully Jun 04 06:41:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b0b9aaa-7ce2-4351-8a84-feca0cd5a651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] Flow 'volume_create_manager' (5cfe5490-43e6-4f73-9c21-728066e13b7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:41:57 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-41a39c49-31d1-4d29-819d-ee4c4739ece0 tempest-AbsoluteLimitsTests-881129387 None] Created volume successfully. Jun 04 06:41:58 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-3a5dc325-1a97-4b1e-a488-131f382b87b4 tempest-AbsoluteLimitsTests-881129387 None] Acquiring lock "cinder-908cad2f-748b-4838-b25c-f9d4e0ec5008-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:41:58 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-3a5dc325-1a97-4b1e-a488-131f382b87b4 tempest-AbsoluteLimitsTests-881129387 None] Lock "cinder-908cad2f-748b-4838-b25c-f9d4e0ec5008-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:41:58 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389 1G" returned: 0 in 0.761s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:58 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-3a5dc325-1a97-4b1e-a488-131f382b87b4 tempest-AbsoluteLimitsTests-881129387 None] Acquiring lock "cinder-quobyte-908cad2f-748b-4838-b25c-f9d4e0ec5008" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:41:58 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-3a5dc325-1a97-4b1e-a488-131f382b87b4 tempest-AbsoluteLimitsTests-881129387 None] Lock "cinder-quobyte-908cad2f-748b-4838-b25c-f9d4e0ec5008" acquired by "delete_volume" :: waited 0.017s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:41:58 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a97f2e-3f03-4ed0-9c34-337efde554e1]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:41:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:58 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[47616201-e047-4370-a610-17127251c37a]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:41:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3a5dc325-1a97-4b1e-a488-131f382b87b4 tempest-AbsoluteLimitsTests-881129387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-908cad2f-748b-4838-b25c-f9d4e0ec5008 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:58 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389 Jun 04 06:41:58 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:58 devstack sudo[101789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-908cad2f-748b-4838-b25c-f9d4e0ec5008 Jun 04 06:41:58 devstack sudo[101789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:59 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389" returned: 0 in 0.756s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:59 devstack sudo[101789]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3a5dc325-1a97-4b1e-a488-131f382b87b4 tempest-AbsoluteLimitsTests-881129387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-908cad2f-748b-4838-b25c-f9d4e0ec5008" returned: 0 in 0.776s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3a5dc325-1a97-4b1e-a488-131f382b87b4 tempest-AbsoluteLimitsTests-881129387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-908cad2f-748b-4838-b25c-f9d4e0ec5008 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:59 devstack sudo[101798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-908cad2f-748b-4838-b25c-f9d4e0ec5008 Jun 04 06:41:59 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:59 devstack sudo[101797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389 Jun 04 06:41:59 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:41:59 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3a5dc325-1a97-4b1e-a488-131f382b87b4 tempest-AbsoluteLimitsTests-881129387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-908cad2f-748b-4838-b25c-f9d4e0ec5008" returned: 0 in 0.655s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:59 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root Jun 04 06:41:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389" returned: 1 in 0.703s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:41:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:41:59 devstack cinder-volume[86069]: DEBUG cinder.volume.volume_utils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Downloaded image 356a113c-ac9f-4c32-896c-2ab17fc4b371 ((None, [{'url': 'file:///opt/stack/data/glance/images/356a113c-ac9f-4c32-896c-2ab17fc4b371', 'metadata': {}}])) to volume 759dbd11-8266-4e77-b683-fe3930fb8389 successfully. {{(pid=86069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 04 06:41:59 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Temporary image 356a113c-ac9f-4c32-896c-2ab17fc4b371 for user 83d8074dbc78486e9247bfcdc0d300be is deleted. {{(pid=86069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 04 06:41:59 devstack cinder-volume[86069]: DEBUG cinder.volume.volume_utils [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Marking volume 759dbd11-8266-4e77-b683-fe3930fb8389 as bootable. {{(pid=86069) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 04 06:41:59 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-3a5dc325-1a97-4b1e-a488-131f382b87b4 tempest-AbsoluteLimitsTests-881129387 None] Lock "cinder-quobyte-908cad2f-748b-4838-b25c-f9d4e0ec5008" released by "delete_volume" :: held 1.501s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:41:59 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Copying metadata from image 356a113c-ac9f-4c32-896c-2ab17fc4b371 to 759dbd11-8266-4e77-b683-fe3930fb8389. {{(pid=86069) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 04 06:41:59 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Creating volume glance metadata for volume 759dbd11-8266-4e77-b683-fe3930fb8389 backed by image 356a113c-ac9f-4c32-896c-2ab17fc4b371 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '356a113c-ac9f-4c32-896c-2ab17fc4b371', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86069) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 04 06:41:59 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-3a5dc325-1a97-4b1e-a488-131f382b87b4 tempest-AbsoluteLimitsTests-881129387 None] Created reservations ['0686fe91-3f34-416f-a2ea-606e45dd7ad1', '895b049b-5cb1-4628-86ee-13d99e658a55', '0c8495e1-8e08-47e5-bd1e-501475f48fb4', 'e8c86dad-69e4-4f85-a847-79c46e25d272'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:41:59 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd34209-9f26-4026-a581-2ad884821539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-759dbd11-8266-4e77-b683-fe3930fb8389', 'volume_size': 1, 'image_id': '356a113c-ac9f-4c32-896c-2ab17fc4b371', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/356a113c-ac9f-4c32-896c-2ab17fc4b371', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73b4c085134a4115abd513b2dd9d6c91', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '356a113c-ac9f-4c32-896c-2ab17fc4b371', 'created_at': datetime.datetime(2026, 6, 4, 4, 19, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 4, 19, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/356a113c-ac9f-4c32-896c-2ab17fc4b371/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:59 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a1acbf-800e-4b15-8194-542db958d41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:41:59 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Volume volume-759dbd11-8266-4e77-b683-fe3930fb8389 (759dbd11-8266-4e77-b683-fe3930fb8389): created successfully Jun 04 06:41:59 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a1acbf-800e-4b15-8194-542db958d41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:41:59 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Flow 'volume_create_manager' (7b9fafaf-3014-4fb4-8d8e-d8e63fcd84c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:41:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-3a5dc325-1a97-4b1e-a488-131f382b87b4 tempest-AbsoluteLimitsTests-881129387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:41:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-3a5dc325-1a97-4b1e-a488-131f382b87b4 tempest-AbsoluteLimitsTests-881129387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:41:59 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-3a5dc325-1a97-4b1e-a488-131f382b87b4 tempest-AbsoluteLimitsTests-881129387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:41:59 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-3a5dc325-1a97-4b1e-a488-131f382b87b4 tempest-AbsoluteLimitsTests-881129387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:41:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-3a5dc325-1a97-4b1e-a488-131f382b87b4 tempest-AbsoluteLimitsTests-881129387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:41:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3a5dc325-1a97-4b1e-a488-131f382b87b4 tempest-AbsoluteLimitsTests-881129387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:41:59 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-0a41110d-1a27-4006-b98f-f599ab98609c tempest-TestShelveInstance-372472869 None] Created volume successfully. Jun 04 06:41:59 devstack sudo[101805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:41:59 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:42:00 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root Jun 04 06:42:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3a5dc325-1a97-4b1e-a488-131f382b87b4 tempest-AbsoluteLimitsTests-881129387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.713s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:42:00 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-3a5dc325-1a97-4b1e-a488-131f382b87b4 tempest-AbsoluteLimitsTests-881129387 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:42:00 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-3a5dc325-1a97-4b1e-a488-131f382b87b4 tempest-AbsoluteLimitsTests-881129387 None] Deleted volume successfully. Jun 04 06:42:00 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-3a5dc325-1a97-4b1e-a488-131f382b87b4 tempest-AbsoluteLimitsTests-881129387 None] Lock "cinder-908cad2f-748b-4838-b25c-f9d4e0ec5008-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:42:04 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:42:04 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] Flow 'volume_create_manager' (563f7a71-90d7-4606-affd-71f1f9b78be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:42:04 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8d74c6d-df65-47e3-a4a1-b87ca5eb78a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:42:04 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8d74c6d-df65-47e3-a4a1-b87ca5eb78a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1675356392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d06b5d66-9b2e-4879-a271-a568b8086e55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b68a7f063f7f4699b56d7ffa1feafd38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:42:05Z,use_quota=True,user_id='1d6743cd50744255b43ff122bb17c6f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:42:04 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd384593-e4ba-470b-8417-820f0bc7cd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:42:04 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd384593-e4ba-470b-8417-820f0bc7cd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:42:04 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22c0e2be-95ec-464e-a57d-71907edea9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:42:04 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22c0e2be-95ec-464e-a57d-71907edea9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd06b5d66-9b2e-4879-a271-a568b8086e55', 'volume_name': 'volume-d06b5d66-9b2e-4879-a271-a568b8086e55', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:42:04 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b3e04b6-9fb6-4360-859f-96791d2517e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:42:04 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b3e04b6-9fb6-4360-859f-96791d2517e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:42:04 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d281e585-2adb-4338-8ade-446ae6a8fb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:42:04 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] Volume d06b5d66-9b2e-4879-a271-a568b8086e55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d06b5d66-9b2e-4879-a271-a568b8086e55', 'volume_size': 1} Jun 04 06:42:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:42:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:42:04 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1675356392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d06b5d66-9b2e-4879-a271-a568b8086e55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b68a7f063f7f4699b56d7ffa1feafd38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:42:05Z,use_quota=True,user_id='1d6743cd50744255b43ff122bb17c6f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:42:04 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] Creating volume d06b5d66-9b2e-4879-a271-a568b8086e55 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:42:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:42:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:42:04 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:42:04 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:42:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:42:04 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:42:04 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:42:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:42:04 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55 1073741824 Jun 04 06:42:04 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:42:05 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Jun 04 06:42:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55 1073741824" returned: 0 in 0.806s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:42:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:42:05 devstack sudo[101818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55 Jun 04 06:42:05 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:42:06 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root Jun 04 06:42:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55" returned: 0 in 0.587s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:42:06 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] <== create_volume: return (1431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:42:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:42:06 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d281e585-2adb-4338-8ade-446ae6a8fb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d06b5d66-9b2e-4879-a271-a568b8086e55', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:42:06 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00ca327d-7cef-455b-9bd0-49d05dc0fa3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:42:06 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] Volume volume-d06b5d66-9b2e-4879-a271-a568b8086e55 (d06b5d66-9b2e-4879-a271-a568b8086e55): created successfully Jun 04 06:42:06 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00ca327d-7cef-455b-9bd0-49d05dc0fa3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:42:06 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] Flow 'volume_create_manager' (563f7a71-90d7-4606-affd-71f1f9b78be8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:42:06 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-5afe3621-bb0b-4e05-991e-10f8fdad58cb tempest-VolumesCloneTest-314127771 None] Created volume successfully. Jun 04 06:42:07 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:42:07 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Flow 'volume_create_manager' (3579004b-9c5e-491f-8d6a-b6a77ad145b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:42:07 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff65369-a235-44ae-8a63-54b0acf02a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:42:07 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff65369-a235-44ae-8a63-54b0acf02a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1127537268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e01c4db-5365-41f3-ad44-d64a88183b85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b68a7f063f7f4699b56d7ffa1feafd38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:42:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=d06b5d66-9b2e-4879-a271-a568b8086e55,status='creating',terminated_at=None,updated_at=2026-06-04T04:42:07Z,use_quota=True,user_id='1d6743cd50744255b43ff122bb17c6f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:42:07 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (669ec398-c835-460d-aea1-a6b4b40ae4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:42:07 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (669ec398-c835-460d-aea1-a6b4b40ae4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:42:07 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a63ec3e-e816-4533-8377-4200835727e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:42:07 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a63ec3e-e816-4533-8377-4200835727e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4e01c4db-5365-41f3-ad44-d64a88183b85', 'volume_name': 'volume-4e01c4db-5365-41f3-ad44-d64a88183b85', 'volume_size': 2, 'source_volid': 'd06b5d66-9b2e-4879-a271-a568b8086e55', 'source_volstatus': 'available'}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:42:07 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96a88123-37cc-482b-bd35-bebc8855880f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:42:07 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96a88123-37cc-482b-bd35-bebc8855880f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:42:07 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4b9eabd-c961-475f-8ede-353d370c4237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:42:07 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Volume 4e01c4db-5365-41f3-ad44-d64a88183b85: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4e01c4db-5365-41f3-ad44-d64a88183b85', 'volume_size': 2, 'source_volid': 'd06b5d66-9b2e-4879-a271-a568b8086e55', 'source_volstatus': 'available'} Jun 04 06:42:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:42:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:42:07 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Cloning volume d06b5d66-9b2e-4879-a271-a568b8086e55 to volume 4e01c4db-5365-41f3-ad44-d64a88183b85 Jun 04 06:42:07 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Creating offline snapshot b980fe70-a4b3-4da5-8fba-d1200daeb2e6 of volume d06b5d66-9b2e-4879-a271-a568b8086e55 {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:42:07 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b17399-e407-4802-a9d0-ca04e1f7df80]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:42:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:42:07 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55 Jun 04 06:42:07 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:42:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-13fb67e7-464c-4d99-9596-df7596e590f9 req-7db40333-fad2-40ba-afe8-89d3a1886e17 tempest-TestShelveInstance-372472869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:42:08 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Jun 04 06:42:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55" returned: 0 in 0.838s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:42:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55.b980fe70-a4b3-4da5-8fba-d1200daeb2e6 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:42:08 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55.b980fe70-a4b3-4da5-8fba-d1200daeb2e6 1G Jun 04 06:42:08 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:42:09 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Jun 04 06:42:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55.b980fe70-a4b3-4da5-8fba-d1200daeb2e6 1G" returned: 0 in 0.856s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:42:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d06b5d66-9b2e-4879-a271-a568b8086e55 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55.b980fe70-a4b3-4da5-8fba-d1200daeb2e6 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:42:09 devstack sudo[101842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d06b5d66-9b2e-4879-a271-a568b8086e55 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55.b980fe70-a4b3-4da5-8fba-d1200daeb2e6 Jun 04 06:42:09 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:42:09 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root Jun 04 06:42:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d06b5d66-9b2e-4879-a271-a568b8086e55 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55.b980fe70-a4b3-4da5-8fba-d1200daeb2e6" returned: 0 in 0.652s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:42:09 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55.b980fe70-a4b3-4da5-8fba-d1200daeb2e6 is being set with open permissions: ugo+rw Jun 04 06:42:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55.b980fe70-a4b3-4da5-8fba-d1200daeb2e6 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:42:09 devstack sudo[101847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55.b980fe70-a4b3-4da5-8fba-d1200daeb2e6 Jun 04 06:42:09 devstack sudo[101847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:42:10 devstack sudo[101847]: pam_unix(sudo:session): session closed for user root Jun 04 06:42:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55.b980fe70-a4b3-4da5-8fba-d1200daeb2e6" returned: 0 in 0.668s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:42:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:42:10 devstack sudo[101850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55.info Jun 04 06:42:10 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:42:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:42:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:42:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:42:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:42:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:42:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:42:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:42:11 devstack sudo[101853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:42:11 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:42:11 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root Jun 04 06:42:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55.info" returned: 0 in 0.588s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:42:11 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55.info is being set with open permissions: ugo+rw Jun 04 06:42:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:42:11 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55.info Jun 04 06:42:11 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:42:11 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root Jun 04 06:42:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.592s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:42:11 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:42:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager._thread_info {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:42:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread count: 28 {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 06:42:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread info: [<_MainThread(MainThread, started 131797370544256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 06:42:11 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Jun 04 06:42:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55.info" returned: 0 in 0.628s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:42:11 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Acquiring lock "cinder-quobyte-4e01c4db-5365-41f3-ad44-d64a88183b85" by "_copy_volume_from_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:42:11 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Lock "cinder-quobyte-4e01c4db-5365-41f3-ad44-d64a88183b85" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:42:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] snapshot: b980fe70-a4b3-4da5-8fba-d1200daeb2e6, volume: 4e01c4db-5365-41f3-ad44-d64a88183b85, {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 06:42:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:42:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:42:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:42:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:42:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:42:11 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5a3de1-b4b6-45fc-9e63-e1bcbb038c71]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:42:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55.b980fe70-a4b3-4da5-8fba-d1200daeb2e6 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:42:11 devstack sudo[101859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55.b980fe70-a4b3-4da5-8fba-d1200daeb2e6 Jun 04 06:42:11 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:42:12 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root Jun 04 06:42:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55.b980fe70-a4b3-4da5-8fba-d1200daeb2e6" returned: 0 in 0.687s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:42:12 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d06b5d66-9b2e-4879-a271-a568b8086e55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:42:12 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55 {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 06:42:12 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Creating direct copy from snapshot {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 06:42:12 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb4d063-336c-4fa5-b9ef-dd7d96c71ee2]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:42:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:42:12 devstack sudo[101864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55 Jun 04 06:42:12 devstack sudo[101864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:42:13 devstack sudo[101864]: pam_unix(sudo:session): session closed for user root Jun 04 06:42:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55" returned: 0 in 0.716s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:42:13 devstack cinder-volume[86069]: DEBUG cinder.utils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Path /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4e01c4db-5365-41f3-ad44-d64a88183b85 not found in is_blk_device check {{(pid=86069) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 04 06:42:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4e01c4db-5365-41f3-ad44-d64a88183b85 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:42:13 devstack sudo[101869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4e01c4db-5365-41f3-ad44-d64a88183b85 Jun 04 06:42:13 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:42:18 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root Jun 04 06:42:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4e01c4db-5365-41f3-ad44-d64a88183b85" returned: 0 in 4.990s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:42:18 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08cba45-27d3-46b3-8aa6-cb54ec5f6ba9]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:42:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:42:18 devstack sudo[101884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55 Jun 04 06:42:18 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:42:19 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root Jun 04 06:42:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55" returned: 0 in 0.838s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:42:19 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Image conversion details: src /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55, size 1024.00 MB, duration 4.99 sec, destination /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4e01c4db-5365-41f3-ad44-d64a88183b85 {{(pid=86069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 06:42:19 devstack cinder-volume[86069]: INFO cinder.image.image_utils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Converted 1024.00 MB image at 205.17 MB/s Jun 04 06:42:19 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4e01c4db-5365-41f3-ad44-d64a88183b85 is being set with open permissions: ugo+rw Jun 04 06:42:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4e01c4db-5365-41f3-ad44-d64a88183b85 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:42:19 devstack sudo[101889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4e01c4db-5365-41f3-ad44-d64a88183b85 Jun 04 06:42:19 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:42:19 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root Jun 04 06:42:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4e01c4db-5365-41f3-ad44-d64a88183b85" returned: 0 in 0.549s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:42:19 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Lock "cinder-quobyte-4e01c4db-5365-41f3-ad44-d64a88183b85" released by "_copy_volume_from_snapshot" :: held 7.858s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:42:19 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Acquiring lock "cinder-quobyte-b980fe70-a4b3-4da5-8fba-d1200daeb2e6" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:42:19 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Lock "cinder-quobyte-b980fe70-a4b3-4da5-8fba-d1200daeb2e6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:42:19 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Deleting offline snapshot b980fe70-a4b3-4da5-8fba-d1200daeb2e6 of volume d06b5d66-9b2e-4879-a271-a568b8086e55 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:42:19 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] snapshot_file for this snap is: volume-d06b5d66-9b2e-4879-a271-a568b8086e55.b980fe70-a4b3-4da5-8fba-d1200daeb2e6 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:42:19 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39b59a1-ce99-4665-a068-ffca04362670]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:42:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55.b980fe70-a4b3-4da5-8fba-d1200daeb2e6 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:42:19 devstack sudo[101892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55.b980fe70-a4b3-4da5-8fba-d1200daeb2e6 Jun 04 06:42:19 devstack sudo[101892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:42:20 devstack sudo[101892]: pam_unix(sudo:session): session closed for user root Jun 04 06:42:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55.b980fe70-a4b3-4da5-8fba-d1200daeb2e6" returned: 0 in 0.681s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:42:20 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d06b5d66-9b2e-4879-a271-a568b8086e55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:42:20 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef621110-4db6-4737-972d-59a0225c6ecd]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:42:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:42:20 devstack sudo[101897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55 Jun 04 06:42:20 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:42:20 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=53,cinder:INSERT=22,cinder:UPDATE=61,cinder:DELETE=6 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:42:21 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root Jun 04 06:42:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55" returned: 0 in 0.706s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:42:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55.b980fe70-a4b3-4da5-8fba-d1200daeb2e6 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:42:21 devstack sudo[101902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55.b980fe70-a4b3-4da5-8fba-d1200daeb2e6 Jun 04 06:42:21 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:42:21 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root Jun 04 06:42:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55.b980fe70-a4b3-4da5-8fba-d1200daeb2e6" returned: 0 in 0.635s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:42:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55.b980fe70-a4b3-4da5-8fba-d1200daeb2e6 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:42:21 devstack sudo[101907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55.b980fe70-a4b3-4da5-8fba-d1200daeb2e6 Jun 04 06:42:21 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:42:22 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root Jun 04 06:42:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55.b980fe70-a4b3-4da5-8fba-d1200daeb2e6" returned: 0 in 0.622s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:42:22 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Lock "cinder-quobyte-b980fe70-a4b3-4da5-8fba-d1200daeb2e6" released by "_delete_snapshot" :: held 2.742s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:42:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.023s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:42:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-13fb67e7-464c-4d99-9596-df7596e590f9 req-7db40333-fad2-40ba-afe8-89d3a1886e17 tempest-TestShelveInstance-372472869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 14.223s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:42:22 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4b9eabd-c961-475f-8ede-353d370c4237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e01c4db-5365-41f3-ad44-d64a88183b85', 'volume_size': 2, 'source_volid': 'd06b5d66-9b2e-4879-a271-a568b8086e55', 'source_volstatus': 'available'}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:42:22 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c93a956-0464-4e8a-b8da-a4209a2c772c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:42:22 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Volume volume-4e01c4db-5365-41f3-ad44-d64a88183b85 (4e01c4db-5365-41f3-ad44-d64a88183b85): created successfully Jun 04 06:42:22 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c93a956-0464-4e8a-b8da-a4209a2c772c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:42:22 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Flow 'volume_create_manager' (3579004b-9c5e-491f-8d6a-b6a77ad145b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:42:22 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff23e65c-b06e-43cb-ba76-f4657e5dc37a]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:42:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-13fb67e7-464c-4d99-9596-df7596e590f9 req-7db40333-fad2-40ba-afe8-89d3a1886e17 tempest-TestShelveInstance-372472869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:42:22 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-bcd3b37d-44bf-4e18-b99b-ba32ca58c7fc tempest-VolumesCloneTest-314127771 None] Created volume successfully. Jun 04 06:42:22 devstack sudo[101910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389 Jun 04 06:42:22 devstack sudo[101910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:42:23 devstack sudo[101910]: pam_unix(sudo:session): session closed for user root Jun 04 06:42:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-13fb67e7-464c-4d99-9596-df7596e590f9 req-7db40333-fad2-40ba-afe8-89d3a1886e17 tempest-TestShelveInstance-372472869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389" returned: 0 in 0.739s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:42:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-13fb67e7-464c-4d99-9596-df7596e590f9 req-7db40333-fad2-40ba-afe8-89d3a1886e17 tempest-TestShelveInstance-372472869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:42:23 devstack sudo[101915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389 Jun 04 06:42:23 devstack sudo[101915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:42:23 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c0a9aa56-7f11-495d-a64e-4612888dc5cf tempest-VolumesCloneTest-314127771 None] Acquiring lock "cinder-4e01c4db-5365-41f3-ad44-d64a88183b85-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:42:23 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c0a9aa56-7f11-495d-a64e-4612888dc5cf tempest-VolumesCloneTest-314127771 None] Lock "cinder-4e01c4db-5365-41f3-ad44-d64a88183b85-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:42:23 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:INSERT=19,cinder:UPDATE=65,cinder:SELECT=44,cinder:DELETE=5 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:42:23 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c0a9aa56-7f11-495d-a64e-4612888dc5cf tempest-VolumesCloneTest-314127771 None] Acquiring lock "cinder-quobyte-4e01c4db-5365-41f3-ad44-d64a88183b85" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:42:23 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c0a9aa56-7f11-495d-a64e-4612888dc5cf tempest-VolumesCloneTest-314127771 None] Lock "cinder-quobyte-4e01c4db-5365-41f3-ad44-d64a88183b85" acquired by "delete_volume" :: waited 0.017s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:42:23 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[0936b41b-6270-438f-bb4e-43b2641f1a5d]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:42:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c0a9aa56-7f11-495d-a64e-4612888dc5cf tempest-VolumesCloneTest-314127771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4e01c4db-5365-41f3-ad44-d64a88183b85 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:42:23 devstack sudo[101917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4e01c4db-5365-41f3-ad44-d64a88183b85 Jun 04 06:42:23 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:42:24 devstack sudo[101915]: pam_unix(sudo:session): session closed for user root Jun 04 06:42:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-13fb67e7-464c-4d99-9596-df7596e590f9 req-7db40333-fad2-40ba-afe8-89d3a1886e17 tempest-TestShelveInstance-372472869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389" returned: 1 in 0.733s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:42:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-13fb67e7-464c-4d99-9596-df7596e590f9 req-7db40333-fad2-40ba-afe8-89d3a1886e17 tempest-TestShelveInstance-372472869 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:42:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-13fb67e7-464c-4d99-9596-df7596e590f9 req-7db40333-fad2-40ba-afe8-89d3a1886e17 tempest-TestShelveInstance-372472869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.537s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:42:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-13fb67e7-464c-4d99-9596-df7596e590f9 req-7db40333-fad2-40ba-afe8-89d3a1886e17 tempest-TestShelveInstance-372472869 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574', 'name': 'volume-759dbd11-8266-4e77-b683-fe3930fb8389', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9f7a9492-27b7-426d-a989-378ca0e4248c', 'enforce_multipath': True} {{(pid=86069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 06:42:24 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-13fb67e7-464c-4d99-9596-df7596e590f9 req-7db40333-fad2-40ba-afe8-89d3a1886e17 tempest-TestShelveInstance-372472869 None] attachment_update completed successfully. Jun 04 06:42:24 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root Jun 04 06:42:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c0a9aa56-7f11-495d-a64e-4612888dc5cf tempest-VolumesCloneTest-314127771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4e01c4db-5365-41f3-ad44-d64a88183b85" returned: 0 in 0.711s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:42:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c0a9aa56-7f11-495d-a64e-4612888dc5cf tempest-VolumesCloneTest-314127771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4e01c4db-5365-41f3-ad44-d64a88183b85 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:42:24 devstack sudo[101925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4e01c4db-5365-41f3-ad44-d64a88183b85 Jun 04 06:42:24 devstack sudo[101925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:42:25 devstack sudo[101925]: pam_unix(sudo:session): session closed for user root Jun 04 06:42:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c0a9aa56-7f11-495d-a64e-4612888dc5cf tempest-VolumesCloneTest-314127771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4e01c4db-5365-41f3-ad44-d64a88183b85" returned: 0 in 0.625s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:42:25 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c0a9aa56-7f11-495d-a64e-4612888dc5cf tempest-VolumesCloneTest-314127771 None] Lock "cinder-quobyte-4e01c4db-5365-41f3-ad44-d64a88183b85" released by "delete_volume" :: held 1.378s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:42:25 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-c0a9aa56-7f11-495d-a64e-4612888dc5cf tempest-VolumesCloneTest-314127771 None] Created reservations ['244978f0-0c92-49a4-aca3-ff70fc5ee28a', 'dedfcd31-f46d-47c5-bbe3-622c98b16688', 'a3918f40-e62e-4633-9728-66a66c62e1fc', '52098a51-3fc9-4f18-a05d-2418e0186bda'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:42:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c0a9aa56-7f11-495d-a64e-4612888dc5cf tempest-VolumesCloneTest-314127771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:42:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c0a9aa56-7f11-495d-a64e-4612888dc5cf tempest-VolumesCloneTest-314127771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:42:25 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c0a9aa56-7f11-495d-a64e-4612888dc5cf tempest-VolumesCloneTest-314127771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:42:25 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c0a9aa56-7f11-495d-a64e-4612888dc5cf tempest-VolumesCloneTest-314127771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:42:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c0a9aa56-7f11-495d-a64e-4612888dc5cf tempest-VolumesCloneTest-314127771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:42:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c0a9aa56-7f11-495d-a64e-4612888dc5cf tempest-VolumesCloneTest-314127771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:42:25 devstack sudo[101928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:42:25 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:42:25 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root Jun 04 06:42:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c0a9aa56-7f11-495d-a64e-4612888dc5cf tempest-VolumesCloneTest-314127771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.571s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:42:25 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-c0a9aa56-7f11-495d-a64e-4612888dc5cf tempest-VolumesCloneTest-314127771 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:42:25 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-c0a9aa56-7f11-495d-a64e-4612888dc5cf tempest-VolumesCloneTest-314127771 None] Deleted volume successfully. Jun 04 06:42:25 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c0a9aa56-7f11-495d-a64e-4612888dc5cf tempest-VolumesCloneTest-314127771 None] Lock "cinder-4e01c4db-5365-41f3-ad44-d64a88183b85-delete_volume" released by "delete_volume" :: held 2.147s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:42:26 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-99ca8100-ebbd-48de-a909-c8fcc7f919b9 tempest-VolumesCloneTest-314127771 None] Acquiring lock "cinder-d06b5d66-9b2e-4879-a271-a568b8086e55-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:42:26 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-99ca8100-ebbd-48de-a909-c8fcc7f919b9 tempest-VolumesCloneTest-314127771 None] Lock "cinder-d06b5d66-9b2e-4879-a271-a568b8086e55-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:42:26 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-99ca8100-ebbd-48de-a909-c8fcc7f919b9 tempest-VolumesCloneTest-314127771 None] Acquiring lock "cinder-quobyte-d06b5d66-9b2e-4879-a271-a568b8086e55" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:42:26 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-99ca8100-ebbd-48de-a909-c8fcc7f919b9 tempest-VolumesCloneTest-314127771 None] Lock "cinder-quobyte-d06b5d66-9b2e-4879-a271-a568b8086e55" acquired by "delete_volume" :: waited 0.018s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:42:26 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b639ae1-0042-4ab2-80bf-2f763c8ccdbe]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:42:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-99ca8100-ebbd-48de-a909-c8fcc7f919b9 tempest-VolumesCloneTest-314127771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:42:26 devstack sudo[101978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55 Jun 04 06:42:26 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:42:26 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root Jun 04 06:42:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-99ca8100-ebbd-48de-a909-c8fcc7f919b9 tempest-VolumesCloneTest-314127771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55" returned: 0 in 0.718s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:42:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-99ca8100-ebbd-48de-a909-c8fcc7f919b9 tempest-VolumesCloneTest-314127771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:42:26 devstack sudo[102003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55 Jun 04 06:42:26 devstack sudo[102003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:42:27 devstack sudo[102003]: pam_unix(sudo:session): session closed for user root Jun 04 06:42:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-99ca8100-ebbd-48de-a909-c8fcc7f919b9 tempest-VolumesCloneTest-314127771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d06b5d66-9b2e-4879-a271-a568b8086e55" returned: 0 in 0.618s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:42:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-99ca8100-ebbd-48de-a909-c8fcc7f919b9 tempest-VolumesCloneTest-314127771 None] Lock "cinder-quobyte-d06b5d66-9b2e-4879-a271-a568b8086e55" released by "delete_volume" :: held 1.417s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:42:27 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-99ca8100-ebbd-48de-a909-c8fcc7f919b9 tempest-VolumesCloneTest-314127771 None] Created reservations ['17446d11-a6ad-4b8d-af8b-02a97b03601c', 'fec95a2f-07b1-4255-ae84-4c1382bdc162', '89a329ae-a011-46e5-901b-243ab1b42918', 'd80eab6a-d2a8-4753-b543-23f3520cba0f'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:42:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-99ca8100-ebbd-48de-a909-c8fcc7f919b9 tempest-VolumesCloneTest-314127771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:42:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-99ca8100-ebbd-48de-a909-c8fcc7f919b9 tempest-VolumesCloneTest-314127771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:42:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-99ca8100-ebbd-48de-a909-c8fcc7f919b9 tempest-VolumesCloneTest-314127771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:42:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-99ca8100-ebbd-48de-a909-c8fcc7f919b9 tempest-VolumesCloneTest-314127771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:42:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-99ca8100-ebbd-48de-a909-c8fcc7f919b9 tempest-VolumesCloneTest-314127771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:42:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-99ca8100-ebbd-48de-a909-c8fcc7f919b9 tempest-VolumesCloneTest-314127771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:42:27 devstack sudo[102010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:42:27 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:42:28 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root Jun 04 06:42:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-99ca8100-ebbd-48de-a909-c8fcc7f919b9 tempest-VolumesCloneTest-314127771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.577s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:42:28 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-99ca8100-ebbd-48de-a909-c8fcc7f919b9 tempest-VolumesCloneTest-314127771 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:42:28 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-99ca8100-ebbd-48de-a909-c8fcc7f919b9 tempest-VolumesCloneTest-314127771 None] Deleted volume successfully. Jun 04 06:42:28 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-99ca8100-ebbd-48de-a909-c8fcc7f919b9 tempest-VolumesCloneTest-314127771 None] Lock "cinder-d06b5d66-9b2e-4879-a271-a568b8086e55-delete_volume" released by "delete_volume" :: held 2.196s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:42:31 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:42:31 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] Flow 'volume_create_manager' (881ae5b7-61aa-4a91-bbf0-536531e0bf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:42:31 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a57a9295-da26-4fdc-85e9-7416afe680ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:42:31 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a57a9295-da26-4fdc-85e9-7416afe680ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1569835138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27f1c7f7-be25-472b-80e1-84138fd6015a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6c65d1e13d4519918df94940a197ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:42:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:42:32Z,use_quota=True,user_id='17303ed6636745b7a75a4ae07f525b9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:42:31 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4331c02e-9522-4b23-b6e8-681e169b24bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:42:31 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4331c02e-9522-4b23-b6e8-681e169b24bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:42:31 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ab477e8-eaba-4e54-befa-32f848d4a8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:42:31 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ab477e8-eaba-4e54-befa-32f848d4a8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27f1c7f7-be25-472b-80e1-84138fd6015a', 'volume_name': 'volume-27f1c7f7-be25-472b-80e1-84138fd6015a', 'volume_size': 2}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:42:31 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8880daba-858b-4738-a7d3-95b36e07e4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:42:31 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8880daba-858b-4738-a7d3-95b36e07e4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:42:31 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67eb6e97-deec-4fc2-bd3a-7f29111544a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:42:31 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] Volume 27f1c7f7-be25-472b-80e1-84138fd6015a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27f1c7f7-be25-472b-80e1-84138fd6015a', 'volume_size': 2} Jun 04 06:42:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:42:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:42:31 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1569835138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27f1c7f7-be25-472b-80e1-84138fd6015a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6c65d1e13d4519918df94940a197ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:42:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:42:32Z,use_quota=True,user_id='17303ed6636745b7a75a4ae07f525b9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:42:31 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] Creating volume 27f1c7f7-be25-472b-80e1-84138fd6015a {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:42:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:42:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:42:31 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:42:31 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:42:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:42:31 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:42:31 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:42:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-27f1c7f7-be25-472b-80e1-84138fd6015a 2147483648 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:42:31 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-27f1c7f7-be25-472b-80e1-84138fd6015a 2147483648 Jun 04 06:42:31 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:42:33 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Jun 04 06:42:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-27f1c7f7-be25-472b-80e1-84138fd6015a 2147483648" returned: 0 in 1.134s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:42:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-27f1c7f7-be25-472b-80e1-84138fd6015a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:42:33 devstack sudo[102427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-27f1c7f7-be25-472b-80e1-84138fd6015a Jun 04 06:42:33 devstack sudo[102427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:42:33 devstack sudo[102427]: pam_unix(sudo:session): session closed for user root Jun 04 06:42:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-27f1c7f7-be25-472b-80e1-84138fd6015a" returned: 0 in 0.772s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:42:33 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] <== create_volume: return (1989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:42:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.995s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:42:33 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67eb6e97-deec-4fc2-bd3a-7f29111544a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27f1c7f7-be25-472b-80e1-84138fd6015a', 'volume_size': 2}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:42:33 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea764663-5451-4c51-a5db-36651b322ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:42:33 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] Volume volume-27f1c7f7-be25-472b-80e1-84138fd6015a (27f1c7f7-be25-472b-80e1-84138fd6015a): created successfully Jun 04 06:42:33 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea764663-5451-4c51-a5db-36651b322ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:42:33 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] Flow 'volume_create_manager' (881ae5b7-61aa-4a91-bbf0-536531e0bf8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:42:33 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-efea48e8-7936-4acf-920f-f55a2b68135a tempest-VolumesCloneNegativeTest-1460362309 None] Created volume successfully. Jun 04 06:42:35 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7479ee1e-7223-473a-9e03-e5c86d7e1d5b tempest-VolumesCloneNegativeTest-1460362309 None] Acquiring lock "cinder-27f1c7f7-be25-472b-80e1-84138fd6015a-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:42:35 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7479ee1e-7223-473a-9e03-e5c86d7e1d5b tempest-VolumesCloneNegativeTest-1460362309 None] Lock "cinder-27f1c7f7-be25-472b-80e1-84138fd6015a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:42:35 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7479ee1e-7223-473a-9e03-e5c86d7e1d5b tempest-VolumesCloneNegativeTest-1460362309 None] Acquiring lock "cinder-quobyte-27f1c7f7-be25-472b-80e1-84138fd6015a" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:42:35 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7479ee1e-7223-473a-9e03-e5c86d7e1d5b tempest-VolumesCloneNegativeTest-1460362309 None] Lock "cinder-quobyte-27f1c7f7-be25-472b-80e1-84138fd6015a" acquired by "delete_volume" :: waited 0.018s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:42:35 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[7333b294-537b-4850-ad8e-e819bfef79ae]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:42:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7479ee1e-7223-473a-9e03-e5c86d7e1d5b tempest-VolumesCloneNegativeTest-1460362309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-27f1c7f7-be25-472b-80e1-84138fd6015a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:42:35 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-27f1c7f7-be25-472b-80e1-84138fd6015a Jun 04 06:42:35 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:42:36 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Jun 04 06:42:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7479ee1e-7223-473a-9e03-e5c86d7e1d5b tempest-VolumesCloneNegativeTest-1460362309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-27f1c7f7-be25-472b-80e1-84138fd6015a" returned: 0 in 0.882s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:42:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7479ee1e-7223-473a-9e03-e5c86d7e1d5b tempest-VolumesCloneNegativeTest-1460362309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-27f1c7f7-be25-472b-80e1-84138fd6015a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:42:36 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-27f1c7f7-be25-472b-80e1-84138fd6015a Jun 04 06:42:36 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:42:36 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Jun 04 06:42:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7479ee1e-7223-473a-9e03-e5c86d7e1d5b tempest-VolumesCloneNegativeTest-1460362309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-27f1c7f7-be25-472b-80e1-84138fd6015a" returned: 0 in 0.644s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:42:37 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7479ee1e-7223-473a-9e03-e5c86d7e1d5b tempest-VolumesCloneNegativeTest-1460362309 None] Lock "cinder-quobyte-27f1c7f7-be25-472b-80e1-84138fd6015a" released by "delete_volume" :: held 1.594s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:42:37 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-7479ee1e-7223-473a-9e03-e5c86d7e1d5b tempest-VolumesCloneNegativeTest-1460362309 None] Created reservations ['7338f1bb-0c3a-4be2-9f4c-f0fd63359412', 'a3eed906-f364-49f3-801e-5e4ec0b15e69', 'e737c257-6beb-4ba8-a45f-9203e781d324', '77e363d1-64ac-4e48-99fb-7781015c14c4'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:42:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7479ee1e-7223-473a-9e03-e5c86d7e1d5b tempest-VolumesCloneNegativeTest-1460362309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:42:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7479ee1e-7223-473a-9e03-e5c86d7e1d5b tempest-VolumesCloneNegativeTest-1460362309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:42:37 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7479ee1e-7223-473a-9e03-e5c86d7e1d5b tempest-VolumesCloneNegativeTest-1460362309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:42:37 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7479ee1e-7223-473a-9e03-e5c86d7e1d5b tempest-VolumesCloneNegativeTest-1460362309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:42:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7479ee1e-7223-473a-9e03-e5c86d7e1d5b tempest-VolumesCloneNegativeTest-1460362309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:42:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7479ee1e-7223-473a-9e03-e5c86d7e1d5b tempest-VolumesCloneNegativeTest-1460362309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:42:37 devstack sudo[102450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:42:37 devstack sudo[102450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:42:37 devstack sudo[102450]: pam_unix(sudo:session): session closed for user root Jun 04 06:42:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7479ee1e-7223-473a-9e03-e5c86d7e1d5b tempest-VolumesCloneNegativeTest-1460362309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.650s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:42:37 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-7479ee1e-7223-473a-9e03-e5c86d7e1d5b tempest-VolumesCloneNegativeTest-1460362309 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:42:37 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-7479ee1e-7223-473a-9e03-e5c86d7e1d5b tempest-VolumesCloneNegativeTest-1460362309 None] Deleted volume successfully. Jun 04 06:42:37 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7479ee1e-7223-473a-9e03-e5c86d7e1d5b tempest-VolumesCloneNegativeTest-1460362309 None] Lock "cinder-27f1c7f7-be25-472b-80e1-84138fd6015a-delete_volume" released by "delete_volume" :: held 2.532s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:42:40 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:42:40 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] Flow 'volume_create_manager' (3b8a38cf-a1c2-4700-ada8-dde06a8448f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:42:40 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83944d00-1633-49f2-ba69-feb04b758fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:42:40 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83944d00-1633-49f2-ba69-feb04b758fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1450478491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6e0469-1a99-4c29-b7e1-25506373ed1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b34a7d1524493bb47b4f2f26dba81b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:42:40Z,use_quota=True,user_id='b028707d93f44e508cd1cb80de7a41ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:42:40 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da6e7723-031c-493d-bb1d-32e26dbc7e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:42:40 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da6e7723-031c-493d-bb1d-32e26dbc7e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:42:40 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d12bebd-d185-4d99-9eb9-f1722d19558c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:42:40 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d12bebd-d185-4d99-9eb9-f1722d19558c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b6e0469-1a99-4c29-b7e1-25506373ed1d', 'volume_name': 'volume-0b6e0469-1a99-4c29-b7e1-25506373ed1d', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:42:40 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56fdca83-5d62-4fcf-b917-c39d0ed64518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:42:40 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56fdca83-5d62-4fcf-b917-c39d0ed64518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:42:40 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac4ed5c1-1924-4748-bb23-193e05b0a2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:42:40 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] Volume 0b6e0469-1a99-4c29-b7e1-25506373ed1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b6e0469-1a99-4c29-b7e1-25506373ed1d', 'volume_size': 1} Jun 04 06:42:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:42:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:42:40 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1450478491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6e0469-1a99-4c29-b7e1-25506373ed1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b34a7d1524493bb47b4f2f26dba81b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:42:40Z,use_quota=True,user_id='b028707d93f44e508cd1cb80de7a41ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:42:40 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] Creating volume 0b6e0469-1a99-4c29-b7e1-25506373ed1d {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:42:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:42:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:42:40 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:42:40 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:42:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:42:40 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:42:40 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:42:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0b6e0469-1a99-4c29-b7e1-25506373ed1d 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:42:40 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0b6e0469-1a99-4c29-b7e1-25506373ed1d 1073741824 Jun 04 06:42:40 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:42:41 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Jun 04 06:42:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0b6e0469-1a99-4c29-b7e1-25506373ed1d 1073741824" returned: 0 in 0.788s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:42:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0b6e0469-1a99-4c29-b7e1-25506373ed1d {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:42:41 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0b6e0469-1a99-4c29-b7e1-25506373ed1d Jun 04 06:42:41 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:42:42 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Jun 04 06:42:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0b6e0469-1a99-4c29-b7e1-25506373ed1d" returned: 0 in 0.593s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:42:42 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] <== create_volume: return (1422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:42:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:42:42 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac4ed5c1-1924-4748-bb23-193e05b0a2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b6e0469-1a99-4c29-b7e1-25506373ed1d', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:42:42 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ad27bd5-ce8e-401d-8936-aa1a1a246cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:42:42 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] Volume volume-0b6e0469-1a99-4c29-b7e1-25506373ed1d (0b6e0469-1a99-4c29-b7e1-25506373ed1d): created successfully Jun 04 06:42:42 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ad27bd5-ce8e-401d-8936-aa1a1a246cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:42:42 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] Flow 'volume_create_manager' (3b8a38cf-a1c2-4700-ada8-dde06a8448f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:42:42 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-5eead83a-4c6c-4107-9c30-981c38faa4ef tempest-VolumesNegativeTest-852333675 None] Created volume successfully. Jun 04 06:42:52 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:UPDATE=32,cinder:SELECT=24,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:42:52 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=24,cinder:INSERT=8,cinder:UPDATE=33,cinder:DELETE=3 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:43:03 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-35ceed77-6399-4fb7-9927-ca16c475df3a req-83cf010b-f1c8-4548-a8bd-a6f42ca3289d tempest-TestShelveInstance-372472869 None] Terminate volume connection completed successfully. Jun 04 06:43:03 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-35ceed77-6399-4fb7-9927-ca16c475df3a req-83cf010b-f1c8-4548-a8bd-a6f42ca3289d tempest-TestShelveInstance-372472869 None] Deleting attachment 9f7a9492-27b7-426d-a989-378ca0e4248c. {{(pid=86069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 06:43:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-afd897d5-cdbc-489b-bcbc-55047b71b275 req-057983a8-8a31-4bcc-b0c8-b685b6f8455f tempest-TestShelveInstance-372472869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:43:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-afd897d5-cdbc-489b-bcbc-55047b71b275 req-057983a8-8a31-4bcc-b0c8-b685b6f8455f tempest-TestShelveInstance-372472869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:43:08 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[9616df78-f83b-4dde-bfd3-4528ed03071b]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:43:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-afd897d5-cdbc-489b-bcbc-55047b71b275 req-057983a8-8a31-4bcc-b0c8-b685b6f8455f tempest-TestShelveInstance-372472869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:08 devstack sudo[102826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389 Jun 04 06:43:08 devstack sudo[102826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:09 devstack sudo[102826]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-afd897d5-cdbc-489b-bcbc-55047b71b275 req-057983a8-8a31-4bcc-b0c8-b685b6f8455f tempest-TestShelveInstance-372472869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389" returned: 0 in 0.788s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-afd897d5-cdbc-489b-bcbc-55047b71b275 req-057983a8-8a31-4bcc-b0c8-b685b6f8455f tempest-TestShelveInstance-372472869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:09 devstack sudo[102832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389 Jun 04 06:43:09 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:10 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-afd897d5-cdbc-489b-bcbc-55047b71b275 req-057983a8-8a31-4bcc-b0c8-b685b6f8455f tempest-TestShelveInstance-372472869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389" returned: 1 in 0.800s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-afd897d5-cdbc-489b-bcbc-55047b71b275 req-057983a8-8a31-4bcc-b0c8-b685b6f8455f tempest-TestShelveInstance-372472869 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:43:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-afd897d5-cdbc-489b-bcbc-55047b71b275 req-057983a8-8a31-4bcc-b0c8-b685b6f8455f tempest-TestShelveInstance-372472869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.645s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:43:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-afd897d5-cdbc-489b-bcbc-55047b71b275 req-057983a8-8a31-4bcc-b0c8-b685b6f8455f tempest-TestShelveInstance-372472869 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574', 'name': 'volume-759dbd11-8266-4e77-b683-fe3930fb8389', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6b17012c-fe37-4c3e-bdf7-4da4e4f3c3ad', 'enforce_multipath': True} {{(pid=86069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 06:43:10 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-afd897d5-cdbc-489b-bcbc-55047b71b275 req-057983a8-8a31-4bcc-b0c8-b685b6f8455f tempest-TestShelveInstance-372472869 None] attachment_update completed successfully. Jun 04 06:43:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:43:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:43:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:43:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:43:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:43:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:43:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:11 devstack sudo[102837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:43:11 devstack sudo[102837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:11 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d15a6bde-2a14-41ad-b61c-399eeb583b47 tempest-VolumesNegativeTest-852333675 None] Acquiring lock "cinder-0b6e0469-1a99-4c29-b7e1-25506373ed1d-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:43:11 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d15a6bde-2a14-41ad-b61c-399eeb583b47 tempest-VolumesNegativeTest-852333675 None] Lock "cinder-0b6e0469-1a99-4c29-b7e1-25506373ed1d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:43:11 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d15a6bde-2a14-41ad-b61c-399eeb583b47 tempest-VolumesNegativeTest-852333675 None] Acquiring lock "cinder-quobyte-0b6e0469-1a99-4c29-b7e1-25506373ed1d" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:43:11 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d15a6bde-2a14-41ad-b61c-399eeb583b47 tempest-VolumesNegativeTest-852333675 None] Lock "cinder-quobyte-0b6e0469-1a99-4c29-b7e1-25506373ed1d" acquired by "delete_volume" :: waited 0.017s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:43:11 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2947d6-f54d-43e9-88ab-0248d601baea]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:43:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d15a6bde-2a14-41ad-b61c-399eeb583b47 tempest-VolumesNegativeTest-852333675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0b6e0469-1a99-4c29-b7e1-25506373ed1d {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:11 devstack sudo[102837]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.631s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:11 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:43:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager._thread_info {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:43:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread count: 28 {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 06:43:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread info: [<_MainThread(MainThread, started 131797370544256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 06:43:11 devstack sudo[102839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0b6e0469-1a99-4c29-b7e1-25506373ed1d Jun 04 06:43:11 devstack sudo[102839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:12 devstack sudo[102839]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d15a6bde-2a14-41ad-b61c-399eeb583b47 tempest-VolumesNegativeTest-852333675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0b6e0469-1a99-4c29-b7e1-25506373ed1d" returned: 0 in 0.714s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d15a6bde-2a14-41ad-b61c-399eeb583b47 tempest-VolumesNegativeTest-852333675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0b6e0469-1a99-4c29-b7e1-25506373ed1d {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:12 devstack sudo[102845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0b6e0469-1a99-4c29-b7e1-25506373ed1d Jun 04 06:43:12 devstack sudo[102845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:13 devstack sudo[102845]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d15a6bde-2a14-41ad-b61c-399eeb583b47 tempest-VolumesNegativeTest-852333675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0b6e0469-1a99-4c29-b7e1-25506373ed1d" returned: 0 in 0.680s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:13 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d15a6bde-2a14-41ad-b61c-399eeb583b47 tempest-VolumesNegativeTest-852333675 None] Lock "cinder-quobyte-0b6e0469-1a99-4c29-b7e1-25506373ed1d" released by "delete_volume" :: held 1.442s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:43:13 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-d15a6bde-2a14-41ad-b61c-399eeb583b47 tempest-VolumesNegativeTest-852333675 None] Created reservations ['525ab1fa-00c9-4c67-b371-ec1b8fc4f6ad', '174db982-d6a9-477a-b2a8-317da4116390', '9cceba6f-22b9-43b0-8106-e249dc4a63ed', 'deb365c7-184d-43ca-aeb2-b33273741ae5'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:43:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d15a6bde-2a14-41ad-b61c-399eeb583b47 tempest-VolumesNegativeTest-852333675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:43:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d15a6bde-2a14-41ad-b61c-399eeb583b47 tempest-VolumesNegativeTest-852333675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:43:13 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d15a6bde-2a14-41ad-b61c-399eeb583b47 tempest-VolumesNegativeTest-852333675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:43:13 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d15a6bde-2a14-41ad-b61c-399eeb583b47 tempest-VolumesNegativeTest-852333675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:43:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d15a6bde-2a14-41ad-b61c-399eeb583b47 tempest-VolumesNegativeTest-852333675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:43:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d15a6bde-2a14-41ad-b61c-399eeb583b47 tempest-VolumesNegativeTest-852333675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:13 devstack sudo[102848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:43:13 devstack sudo[102848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:13 devstack sudo[102848]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d15a6bde-2a14-41ad-b61c-399eeb583b47 tempest-VolumesNegativeTest-852333675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.605s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:13 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-d15a6bde-2a14-41ad-b61c-399eeb583b47 tempest-VolumesNegativeTest-852333675 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:43:13 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-d15a6bde-2a14-41ad-b61c-399eeb583b47 tempest-VolumesNegativeTest-852333675 None] Deleted volume successfully. Jun 04 06:43:13 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d15a6bde-2a14-41ad-b61c-399eeb583b47 tempest-VolumesNegativeTest-852333675 None] Lock "cinder-0b6e0469-1a99-4c29-b7e1-25506373ed1d-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:43:16 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:43:16 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] Flow 'volume_create_manager' (d31ddb21-e68f-4f99-a91d-7bf5edb3a13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:43:16 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4511c23e-9b63-45c7-9ac1-4b8bd68d9562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:43:16 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4511c23e-9b63-45c7-9ac1-4b8bd68d9562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1827836274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b08f3008-c32e-40a1-b053-9984e3667b18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14b44e0453ba406dba045720068e1971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:43:16Z,use_quota=True,user_id='718b807160824e15a50e2d718c66c639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:43:16 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b31392b0-f71e-413f-ac17-51aeacc43f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:43:16 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b31392b0-f71e-413f-ac17-51aeacc43f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:43:16 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f11c3e27-ccc5-4dd4-a9e5-9ab65f063a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:43:16 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f11c3e27-ccc5-4dd4-a9e5-9ab65f063a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b08f3008-c32e-40a1-b053-9984e3667b18', 'volume_name': 'volume-b08f3008-c32e-40a1-b053-9984e3667b18', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:43:16 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa225bdd-25b0-48fd-b9cb-c4f905f377d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:43:16 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa225bdd-25b0-48fd-b9cb-c4f905f377d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:43:16 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1e3e2ca-add7-41c0-bb8e-d85c85f619d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:43:16 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] Volume b08f3008-c32e-40a1-b053-9984e3667b18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b08f3008-c32e-40a1-b053-9984e3667b18', 'volume_size': 1} Jun 04 06:43:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:43:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:43:16 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1827836274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b08f3008-c32e-40a1-b053-9984e3667b18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14b44e0453ba406dba045720068e1971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:43:16Z,use_quota=True,user_id='718b807160824e15a50e2d718c66c639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:43:16 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] Creating volume b08f3008-c32e-40a1-b053-9984e3667b18 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:43:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:43:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:43:16 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:43:16 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:43:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:43:16 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:43:16 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:43:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:16 devstack sudo[102856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18 1073741824 Jun 04 06:43:16 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:17 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18 1073741824" returned: 0 in 0.974s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:17 devstack sudo[102863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18 Jun 04 06:43:17 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:18 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18" returned: 0 in 0.704s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:18 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] <== create_volume: return (1746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:43:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:43:18 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1e3e2ca-add7-41c0-bb8e-d85c85f619d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b08f3008-c32e-40a1-b053-9984e3667b18', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:43:18 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df2b23ba-4767-4a0a-baca-015b816232f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:43:18 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] Volume volume-b08f3008-c32e-40a1-b053-9984e3667b18 (b08f3008-c32e-40a1-b053-9984e3667b18): created successfully Jun 04 06:43:18 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df2b23ba-4767-4a0a-baca-015b816232f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:43:18 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] Flow 'volume_create_manager' (d31ddb21-e68f-4f99-a91d-7bf5edb3a13b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:43:18 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-94946622-0138-4afb-ae9d-a8d676f00787 tempest-VolumesSnapshotListTestJSON-1739592163 None] Created volume successfully. Jun 04 06:43:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-109cbbce-70f7-47b8-a549-8a6dec78287f tempest-VolumesSnapshotListTestJSON-1739592163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:43:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-109cbbce-70f7-47b8-a549-8a6dec78287f tempest-VolumesSnapshotListTestJSON-1739592163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:43:18 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-109cbbce-70f7-47b8-a549-8a6dec78287f tempest-VolumesSnapshotListTestJSON-1739592163 None] Creating offline snapshot 4072a7ae-bdcf-47b5-974d-c8d8c84e02d3 of volume b08f3008-c32e-40a1-b053-9984e3667b18 {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:43:18 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[915d67d4-6e4f-40bb-883e-f9f6ab575535]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:43:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-109cbbce-70f7-47b8-a549-8a6dec78287f tempest-VolumesSnapshotListTestJSON-1739592163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:18 devstack sudo[102933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18 Jun 04 06:43:19 devstack sudo[102933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:19 devstack sudo[102933]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-109cbbce-70f7-47b8-a549-8a6dec78287f tempest-VolumesSnapshotListTestJSON-1739592163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18" returned: 0 in 0.720s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-109cbbce-70f7-47b8-a549-8a6dec78287f tempest-VolumesSnapshotListTestJSON-1739592163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.4072a7ae-bdcf-47b5-974d-c8d8c84e02d3 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:19 devstack sudo[102941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.4072a7ae-bdcf-47b5-974d-c8d8c84e02d3 1G Jun 04 06:43:19 devstack sudo[102941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:20 devstack sudo[102941]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-109cbbce-70f7-47b8-a549-8a6dec78287f tempest-VolumesSnapshotListTestJSON-1739592163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.4072a7ae-bdcf-47b5-974d-c8d8c84e02d3 1G" returned: 0 in 0.873s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-109cbbce-70f7-47b8-a549-8a6dec78287f tempest-VolumesSnapshotListTestJSON-1739592163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b08f3008-c32e-40a1-b053-9984e3667b18 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.4072a7ae-bdcf-47b5-974d-c8d8c84e02d3 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:20 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b08f3008-c32e-40a1-b053-9984e3667b18 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.4072a7ae-bdcf-47b5-974d-c8d8c84e02d3 Jun 04 06:43:20 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:21 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-109cbbce-70f7-47b8-a549-8a6dec78287f tempest-VolumesSnapshotListTestJSON-1739592163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b08f3008-c32e-40a1-b053-9984e3667b18 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.4072a7ae-bdcf-47b5-974d-c8d8c84e02d3" returned: 0 in 0.962s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:21 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-109cbbce-70f7-47b8-a549-8a6dec78287f tempest-VolumesSnapshotListTestJSON-1739592163 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.4072a7ae-bdcf-47b5-974d-c8d8c84e02d3 is being set with open permissions: ugo+rw Jun 04 06:43:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-109cbbce-70f7-47b8-a549-8a6dec78287f tempest-VolumesSnapshotListTestJSON-1739592163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.4072a7ae-bdcf-47b5-974d-c8d8c84e02d3 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:21 devstack sudo[103314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.4072a7ae-bdcf-47b5-974d-c8d8c84e02d3 Jun 04 06:43:21 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:22 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-109cbbce-70f7-47b8-a549-8a6dec78287f tempest-VolumesSnapshotListTestJSON-1739592163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.4072a7ae-bdcf-47b5-974d-c8d8c84e02d3" returned: 0 in 0.828s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-109cbbce-70f7-47b8-a549-8a6dec78287f tempest-VolumesSnapshotListTestJSON-1739592163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:22 devstack sudo[103328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.info Jun 04 06:43:22 devstack sudo[103328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:22 devstack sudo[103328]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-109cbbce-70f7-47b8-a549-8a6dec78287f tempest-VolumesSnapshotListTestJSON-1739592163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.info" returned: 0 in 0.704s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:23 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-109cbbce-70f7-47b8-a549-8a6dec78287f tempest-VolumesSnapshotListTestJSON-1739592163 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.info is being set with open permissions: ugo+rw Jun 04 06:43:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-109cbbce-70f7-47b8-a549-8a6dec78287f tempest-VolumesSnapshotListTestJSON-1739592163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:23 devstack sudo[103333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.info Jun 04 06:43:23 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:23 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-109cbbce-70f7-47b8-a549-8a6dec78287f tempest-VolumesSnapshotListTestJSON-1739592163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.info" returned: 0 in 0.603s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-109cbbce-70f7-47b8-a549-8a6dec78287f tempest-VolumesSnapshotListTestJSON-1739592163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.786s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:43:23 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-109cbbce-70f7-47b8-a549-8a6dec78287f tempest-VolumesSnapshotListTestJSON-1739592163 None] Create snapshot completed successfully Jun 04 06:43:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-fdec867a-f09b-4e60-8e00-a07d2889d6e7 tempest-VolumesSnapshotListTestJSON-1739592163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:43:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-fdec867a-f09b-4e60-8e00-a07d2889d6e7 tempest-VolumesSnapshotListTestJSON-1739592163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:43:24 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-fdec867a-f09b-4e60-8e00-a07d2889d6e7 tempest-VolumesSnapshotListTestJSON-1739592163 None] Creating offline snapshot e63703df-cbff-47d1-b05d-46f4c63aa295 of volume b08f3008-c32e-40a1-b053-9984e3667b18 {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:43:24 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[662d4eb6-0723-4365-8647-2ea7ea3c4da3]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:43:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fdec867a-f09b-4e60-8e00-a07d2889d6e7 tempest-VolumesSnapshotListTestJSON-1739592163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.4072a7ae-bdcf-47b5-974d-c8d8c84e02d3 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:24 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.4072a7ae-bdcf-47b5-974d-c8d8c84e02d3 Jun 04 06:43:24 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:25 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fdec867a-f09b-4e60-8e00-a07d2889d6e7 tempest-VolumesSnapshotListTestJSON-1739592163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.4072a7ae-bdcf-47b5-974d-c8d8c84e02d3" returned: 0 in 0.790s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:25 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-fdec867a-f09b-4e60-8e00-a07d2889d6e7 tempest-VolumesSnapshotListTestJSON-1739592163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b08f3008-c32e-40a1-b053-9984e3667b18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:43:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fdec867a-f09b-4e60-8e00-a07d2889d6e7 tempest-VolumesSnapshotListTestJSON-1739592163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.4072a7ae-bdcf-47b5-974d-c8d8c84e02d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.e63703df-cbff-47d1-b05d-46f4c63aa295 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:25 devstack sudo[103341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.4072a7ae-bdcf-47b5-974d-c8d8c84e02d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.e63703df-cbff-47d1-b05d-46f4c63aa295 1G Jun 04 06:43:25 devstack sudo[103341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:25 devstack sudo[103341]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fdec867a-f09b-4e60-8e00-a07d2889d6e7 tempest-VolumesSnapshotListTestJSON-1739592163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.4072a7ae-bdcf-47b5-974d-c8d8c84e02d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.e63703df-cbff-47d1-b05d-46f4c63aa295 1G" returned: 0 in 0.837s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fdec867a-f09b-4e60-8e00-a07d2889d6e7 tempest-VolumesSnapshotListTestJSON-1739592163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b08f3008-c32e-40a1-b053-9984e3667b18.4072a7ae-bdcf-47b5-974d-c8d8c84e02d3 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.e63703df-cbff-47d1-b05d-46f4c63aa295 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:25 devstack sudo[103347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b08f3008-c32e-40a1-b053-9984e3667b18.4072a7ae-bdcf-47b5-974d-c8d8c84e02d3 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.e63703df-cbff-47d1-b05d-46f4c63aa295 Jun 04 06:43:25 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:26 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fdec867a-f09b-4e60-8e00-a07d2889d6e7 tempest-VolumesSnapshotListTestJSON-1739592163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b08f3008-c32e-40a1-b053-9984e3667b18.4072a7ae-bdcf-47b5-974d-c8d8c84e02d3 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.e63703df-cbff-47d1-b05d-46f4c63aa295" returned: 0 in 0.652s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:26 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-fdec867a-f09b-4e60-8e00-a07d2889d6e7 tempest-VolumesSnapshotListTestJSON-1739592163 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.e63703df-cbff-47d1-b05d-46f4c63aa295 is being set with open permissions: ugo+rw Jun 04 06:43:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fdec867a-f09b-4e60-8e00-a07d2889d6e7 tempest-VolumesSnapshotListTestJSON-1739592163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.e63703df-cbff-47d1-b05d-46f4c63aa295 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:26 devstack sudo[103352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.e63703df-cbff-47d1-b05d-46f4c63aa295 Jun 04 06:43:26 devstack sudo[103352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:27 devstack sudo[103352]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fdec867a-f09b-4e60-8e00-a07d2889d6e7 tempest-VolumesSnapshotListTestJSON-1739592163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.e63703df-cbff-47d1-b05d-46f4c63aa295" returned: 0 in 0.594s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-fdec867a-f09b-4e60-8e00-a07d2889d6e7 tempest-VolumesSnapshotListTestJSON-1739592163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.975s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:43:27 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-fdec867a-f09b-4e60-8e00-a07d2889d6e7 tempest-VolumesSnapshotListTestJSON-1739592163 None] Create snapshot completed successfully Jun 04 06:43:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f96a6b84-1e03-4f92-8c20-0c50008043af tempest-VolumesSnapshotListTestJSON-1739592163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:43:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f96a6b84-1e03-4f92-8c20-0c50008043af tempest-VolumesSnapshotListTestJSON-1739592163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:43:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-f96a6b84-1e03-4f92-8c20-0c50008043af tempest-VolumesSnapshotListTestJSON-1739592163 None] Creating offline snapshot dfce889e-6e16-4247-aadd-ae99e0915822 of volume b08f3008-c32e-40a1-b053-9984e3667b18 {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:43:27 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd12e9f-8c2c-4635-950a-76cfd1d1a9ed]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:43:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f96a6b84-1e03-4f92-8c20-0c50008043af tempest-VolumesSnapshotListTestJSON-1739592163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.e63703df-cbff-47d1-b05d-46f4c63aa295 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:27 devstack sudo[103356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.e63703df-cbff-47d1-b05d-46f4c63aa295 Jun 04 06:43:27 devstack sudo[103356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:28 devstack sudo[103356]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f96a6b84-1e03-4f92-8c20-0c50008043af tempest-VolumesSnapshotListTestJSON-1739592163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.e63703df-cbff-47d1-b05d-46f4c63aa295" returned: 0 in 0.711s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:28 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-f96a6b84-1e03-4f92-8c20-0c50008043af tempest-VolumesSnapshotListTestJSON-1739592163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b08f3008-c32e-40a1-b053-9984e3667b18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:43:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f96a6b84-1e03-4f92-8c20-0c50008043af tempest-VolumesSnapshotListTestJSON-1739592163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.e63703df-cbff-47d1-b05d-46f4c63aa295,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.dfce889e-6e16-4247-aadd-ae99e0915822 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:28 devstack sudo[103361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.e63703df-cbff-47d1-b05d-46f4c63aa295,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.dfce889e-6e16-4247-aadd-ae99e0915822 1G Jun 04 06:43:28 devstack sudo[103361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:29 devstack sudo[103361]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f96a6b84-1e03-4f92-8c20-0c50008043af tempest-VolumesSnapshotListTestJSON-1739592163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.e63703df-cbff-47d1-b05d-46f4c63aa295,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.dfce889e-6e16-4247-aadd-ae99e0915822 1G" returned: 0 in 0.843s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f96a6b84-1e03-4f92-8c20-0c50008043af tempest-VolumesSnapshotListTestJSON-1739592163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b08f3008-c32e-40a1-b053-9984e3667b18.e63703df-cbff-47d1-b05d-46f4c63aa295 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.dfce889e-6e16-4247-aadd-ae99e0915822 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:29 devstack sudo[103366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b08f3008-c32e-40a1-b053-9984e3667b18.e63703df-cbff-47d1-b05d-46f4c63aa295 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.dfce889e-6e16-4247-aadd-ae99e0915822 Jun 04 06:43:29 devstack sudo[103366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:29 devstack sudo[103366]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f96a6b84-1e03-4f92-8c20-0c50008043af tempest-VolumesSnapshotListTestJSON-1739592163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b08f3008-c32e-40a1-b053-9984e3667b18.e63703df-cbff-47d1-b05d-46f4c63aa295 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.dfce889e-6e16-4247-aadd-ae99e0915822" returned: 0 in 0.670s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:29 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-f96a6b84-1e03-4f92-8c20-0c50008043af tempest-VolumesSnapshotListTestJSON-1739592163 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.dfce889e-6e16-4247-aadd-ae99e0915822 is being set with open permissions: ugo+rw Jun 04 06:43:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f96a6b84-1e03-4f92-8c20-0c50008043af tempest-VolumesSnapshotListTestJSON-1739592163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.dfce889e-6e16-4247-aadd-ae99e0915822 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:29 devstack sudo[103371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.dfce889e-6e16-4247-aadd-ae99e0915822 Jun 04 06:43:29 devstack sudo[103371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:30 devstack sudo[103371]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f96a6b84-1e03-4f92-8c20-0c50008043af tempest-VolumesSnapshotListTestJSON-1739592163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.dfce889e-6e16-4247-aadd-ae99e0915822" returned: 0 in 0.600s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f96a6b84-1e03-4f92-8c20-0c50008043af tempest-VolumesSnapshotListTestJSON-1739592163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.923s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:43:30 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-f96a6b84-1e03-4f92-8c20-0c50008043af tempest-VolumesSnapshotListTestJSON-1739592163 None] Create snapshot completed successfully Jun 04 06:43:31 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ae7d96dd-5048-4b6e-b2e7-491392f09f6f tempest-VolumesSnapshotListTestJSON-1739592163 None] Acquiring lock "cinder-dfce889e-6e16-4247-aadd-ae99e0915822-delete_snapshot" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:43:31 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ae7d96dd-5048-4b6e-b2e7-491392f09f6f tempest-VolumesSnapshotListTestJSON-1739592163 None] Lock "cinder-dfce889e-6e16-4247-aadd-ae99e0915822-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:43:31 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ae7d96dd-5048-4b6e-b2e7-491392f09f6f tempest-VolumesSnapshotListTestJSON-1739592163 None] Acquiring lock "cinder-quobyte-b08f3008-c32e-40a1-b053-9984e3667b18" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:43:31 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ae7d96dd-5048-4b6e-b2e7-491392f09f6f tempest-VolumesSnapshotListTestJSON-1739592163 None] Lock "cinder-quobyte-b08f3008-c32e-40a1-b053-9984e3667b18" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:43:31 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ae7d96dd-5048-4b6e-b2e7-491392f09f6f tempest-VolumesSnapshotListTestJSON-1739592163 None] Acquiring lock "cinder-quobyte-dfce889e-6e16-4247-aadd-ae99e0915822" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:43:31 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ae7d96dd-5048-4b6e-b2e7-491392f09f6f tempest-VolumesSnapshotListTestJSON-1739592163 None] Lock "cinder-quobyte-dfce889e-6e16-4247-aadd-ae99e0915822" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:43:31 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-ae7d96dd-5048-4b6e-b2e7-491392f09f6f tempest-VolumesSnapshotListTestJSON-1739592163 None] Deleting offline snapshot dfce889e-6e16-4247-aadd-ae99e0915822 of volume b08f3008-c32e-40a1-b053-9984e3667b18 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:43:31 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-ae7d96dd-5048-4b6e-b2e7-491392f09f6f tempest-VolumesSnapshotListTestJSON-1739592163 None] snapshot_file for this snap is: volume-b08f3008-c32e-40a1-b053-9984e3667b18.dfce889e-6e16-4247-aadd-ae99e0915822 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:43:31 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[c253e9d8-5433-4091-9b99-ade3d0699bd9]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:43:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ae7d96dd-5048-4b6e-b2e7-491392f09f6f tempest-VolumesSnapshotListTestJSON-1739592163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.dfce889e-6e16-4247-aadd-ae99e0915822 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:31 devstack sudo[103374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.dfce889e-6e16-4247-aadd-ae99e0915822 Jun 04 06:43:31 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:32 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ae7d96dd-5048-4b6e-b2e7-491392f09f6f tempest-VolumesSnapshotListTestJSON-1739592163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.dfce889e-6e16-4247-aadd-ae99e0915822" returned: 0 in 0.762s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:32 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-ae7d96dd-5048-4b6e-b2e7-491392f09f6f tempest-VolumesSnapshotListTestJSON-1739592163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b08f3008-c32e-40a1-b053-9984e3667b18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:43:32 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff68a0e-e7c2-4ad2-b6b9-fdb336238267]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:43:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ae7d96dd-5048-4b6e-b2e7-491392f09f6f tempest-VolumesSnapshotListTestJSON-1739592163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.e63703df-cbff-47d1-b05d-46f4c63aa295 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:32 devstack sudo[103379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.e63703df-cbff-47d1-b05d-46f4c63aa295 Jun 04 06:43:32 devstack sudo[103379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:33 devstack sudo[103379]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ae7d96dd-5048-4b6e-b2e7-491392f09f6f tempest-VolumesSnapshotListTestJSON-1739592163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.e63703df-cbff-47d1-b05d-46f4c63aa295" returned: 0 in 0.705s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:33 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-ae7d96dd-5048-4b6e-b2e7-491392f09f6f tempest-VolumesSnapshotListTestJSON-1739592163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b08f3008-c32e-40a1-b053-9984e3667b18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:43:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ae7d96dd-5048-4b6e-b2e7-491392f09f6f tempest-VolumesSnapshotListTestJSON-1739592163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.dfce889e-6e16-4247-aadd-ae99e0915822 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:33 devstack sudo[103384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.dfce889e-6e16-4247-aadd-ae99e0915822 Jun 04 06:43:33 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:33 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ae7d96dd-5048-4b6e-b2e7-491392f09f6f tempest-VolumesSnapshotListTestJSON-1739592163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.dfce889e-6e16-4247-aadd-ae99e0915822" returned: 0 in 0.763s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ae7d96dd-5048-4b6e-b2e7-491392f09f6f tempest-VolumesSnapshotListTestJSON-1739592163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.dfce889e-6e16-4247-aadd-ae99e0915822 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:33 devstack sudo[103423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.dfce889e-6e16-4247-aadd-ae99e0915822 Jun 04 06:43:33 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:34 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ae7d96dd-5048-4b6e-b2e7-491392f09f6f tempest-VolumesSnapshotListTestJSON-1739592163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.dfce889e-6e16-4247-aadd-ae99e0915822" returned: 0 in 0.645s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ae7d96dd-5048-4b6e-b2e7-491392f09f6f tempest-VolumesSnapshotListTestJSON-1739592163 None] Lock "cinder-quobyte-dfce889e-6e16-4247-aadd-ae99e0915822" released by "_delete_snapshot" :: held 2.977s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:43:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ae7d96dd-5048-4b6e-b2e7-491392f09f6f tempest-VolumesSnapshotListTestJSON-1739592163 None] Lock "cinder-quobyte-b08f3008-c32e-40a1-b053-9984e3667b18" released by "delete_snapshot" :: held 3.004s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:43:34 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-ae7d96dd-5048-4b6e-b2e7-491392f09f6f tempest-VolumesSnapshotListTestJSON-1739592163 None] Created reservations ['57a8beea-f93a-4af9-b5db-8aeb353d8a34', 'a6b2b50c-cbe5-48e6-9fa4-6a8588c6d014', '520ae612-e987-4120-af15-6c8a1a4e0171', '6fa29a66-65a5-467d-888f-1734f339f36d'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:43:34 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-ae7d96dd-5048-4b6e-b2e7-491392f09f6f tempest-VolumesSnapshotListTestJSON-1739592163 None] Delete snapshot completed successfully. Jun 04 06:43:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ae7d96dd-5048-4b6e-b2e7-491392f09f6f tempest-VolumesSnapshotListTestJSON-1739592163 None] Lock "cinder-dfce889e-6e16-4247-aadd-ae99e0915822-delete_snapshot" released by "delete_snapshot" :: held 3.159s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:43:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-99986364-f2f3-4f70-aac5-305bb7e50ca5 tempest-VolumesSnapshotListTestJSON-1739592163 None] Acquiring lock "cinder-e63703df-cbff-47d1-b05d-46f4c63aa295-delete_snapshot" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:43:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-99986364-f2f3-4f70-aac5-305bb7e50ca5 tempest-VolumesSnapshotListTestJSON-1739592163 None] Lock "cinder-e63703df-cbff-47d1-b05d-46f4c63aa295-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:43:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-99986364-f2f3-4f70-aac5-305bb7e50ca5 tempest-VolumesSnapshotListTestJSON-1739592163 None] Acquiring lock "cinder-quobyte-b08f3008-c32e-40a1-b053-9984e3667b18" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:43:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-99986364-f2f3-4f70-aac5-305bb7e50ca5 tempest-VolumesSnapshotListTestJSON-1739592163 None] Lock "cinder-quobyte-b08f3008-c32e-40a1-b053-9984e3667b18" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:43:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-99986364-f2f3-4f70-aac5-305bb7e50ca5 tempest-VolumesSnapshotListTestJSON-1739592163 None] Acquiring lock "cinder-quobyte-e63703df-cbff-47d1-b05d-46f4c63aa295" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:43:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-99986364-f2f3-4f70-aac5-305bb7e50ca5 tempest-VolumesSnapshotListTestJSON-1739592163 None] Lock "cinder-quobyte-e63703df-cbff-47d1-b05d-46f4c63aa295" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:43:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-99986364-f2f3-4f70-aac5-305bb7e50ca5 tempest-VolumesSnapshotListTestJSON-1739592163 None] Deleting offline snapshot e63703df-cbff-47d1-b05d-46f4c63aa295 of volume b08f3008-c32e-40a1-b053-9984e3667b18 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:43:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-99986364-f2f3-4f70-aac5-305bb7e50ca5 tempest-VolumesSnapshotListTestJSON-1739592163 None] snapshot_file for this snap is: volume-b08f3008-c32e-40a1-b053-9984e3667b18.e63703df-cbff-47d1-b05d-46f4c63aa295 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:43:34 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc34b9b-f06d-4d87-9e73-9ab66d30ed79]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:43:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-99986364-f2f3-4f70-aac5-305bb7e50ca5 tempest-VolumesSnapshotListTestJSON-1739592163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.e63703df-cbff-47d1-b05d-46f4c63aa295 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:34 devstack sudo[103434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.e63703df-cbff-47d1-b05d-46f4c63aa295 Jun 04 06:43:34 devstack sudo[103434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:35 devstack sudo[103434]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-99986364-f2f3-4f70-aac5-305bb7e50ca5 tempest-VolumesSnapshotListTestJSON-1739592163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.e63703df-cbff-47d1-b05d-46f4c63aa295" returned: 0 in 0.715s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-99986364-f2f3-4f70-aac5-305bb7e50ca5 tempest-VolumesSnapshotListTestJSON-1739592163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b08f3008-c32e-40a1-b053-9984e3667b18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:43:35 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17e2c4c-5aa3-40b3-a997-9c3e8f3b402f]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:43:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-99986364-f2f3-4f70-aac5-305bb7e50ca5 tempest-VolumesSnapshotListTestJSON-1739592163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.4072a7ae-bdcf-47b5-974d-c8d8c84e02d3 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:35 devstack sudo[103439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.4072a7ae-bdcf-47b5-974d-c8d8c84e02d3 Jun 04 06:43:35 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:36 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-99986364-f2f3-4f70-aac5-305bb7e50ca5 tempest-VolumesSnapshotListTestJSON-1739592163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.4072a7ae-bdcf-47b5-974d-c8d8c84e02d3" returned: 0 in 0.812s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:36 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-99986364-f2f3-4f70-aac5-305bb7e50ca5 tempest-VolumesSnapshotListTestJSON-1739592163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b08f3008-c32e-40a1-b053-9984e3667b18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:43:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-99986364-f2f3-4f70-aac5-305bb7e50ca5 tempest-VolumesSnapshotListTestJSON-1739592163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.e63703df-cbff-47d1-b05d-46f4c63aa295 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:36 devstack sudo[103453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.e63703df-cbff-47d1-b05d-46f4c63aa295 Jun 04 06:43:36 devstack sudo[103453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:37 devstack sudo[103453]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-99986364-f2f3-4f70-aac5-305bb7e50ca5 tempest-VolumesSnapshotListTestJSON-1739592163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.e63703df-cbff-47d1-b05d-46f4c63aa295" returned: 0 in 0.862s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-99986364-f2f3-4f70-aac5-305bb7e50ca5 tempest-VolumesSnapshotListTestJSON-1739592163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.e63703df-cbff-47d1-b05d-46f4c63aa295 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:37 devstack sudo[103459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.e63703df-cbff-47d1-b05d-46f4c63aa295 Jun 04 06:43:37 devstack sudo[103459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:38 devstack sudo[103459]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-99986364-f2f3-4f70-aac5-305bb7e50ca5 tempest-VolumesSnapshotListTestJSON-1739592163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.e63703df-cbff-47d1-b05d-46f4c63aa295" returned: 0 in 0.712s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:38 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-99986364-f2f3-4f70-aac5-305bb7e50ca5 tempest-VolumesSnapshotListTestJSON-1739592163 None] Lock "cinder-quobyte-e63703df-cbff-47d1-b05d-46f4c63aa295" released by "_delete_snapshot" :: held 3.205s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:43:38 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-99986364-f2f3-4f70-aac5-305bb7e50ca5 tempest-VolumesSnapshotListTestJSON-1739592163 None] Lock "cinder-quobyte-b08f3008-c32e-40a1-b053-9984e3667b18" released by "delete_snapshot" :: held 3.235s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:43:38 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-99986364-f2f3-4f70-aac5-305bb7e50ca5 tempest-VolumesSnapshotListTestJSON-1739592163 None] Created reservations ['e3512016-ec0d-4e89-9ae4-805506872e42', '992b6a78-75f6-4867-bed6-b65bc87acc44', '5206e5e7-6525-43d1-bfa1-d8a3b389e162', '5cbdbf39-000b-4f75-adc8-0d80f103b248'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:43:38 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-99986364-f2f3-4f70-aac5-305bb7e50ca5 tempest-VolumesSnapshotListTestJSON-1739592163 None] Delete snapshot completed successfully. Jun 04 06:43:38 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-99986364-f2f3-4f70-aac5-305bb7e50ca5 tempest-VolumesSnapshotListTestJSON-1739592163 None] Lock "cinder-e63703df-cbff-47d1-b05d-46f4c63aa295-delete_snapshot" released by "delete_snapshot" :: held 3.379s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:43:38 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-21d2ba7e-006c-4076-9edd-84a0a5932636 tempest-VolumesSnapshotListTestJSON-1739592163 None] Acquiring lock "cinder-4072a7ae-bdcf-47b5-974d-c8d8c84e02d3-delete_snapshot" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:43:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-21d2ba7e-006c-4076-9edd-84a0a5932636 tempest-VolumesSnapshotListTestJSON-1739592163 None] Lock "cinder-4072a7ae-bdcf-47b5-974d-c8d8c84e02d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:43:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-21d2ba7e-006c-4076-9edd-84a0a5932636 tempest-VolumesSnapshotListTestJSON-1739592163 None] Acquiring lock "cinder-quobyte-b08f3008-c32e-40a1-b053-9984e3667b18" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:43:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-21d2ba7e-006c-4076-9edd-84a0a5932636 tempest-VolumesSnapshotListTestJSON-1739592163 None] Lock "cinder-quobyte-b08f3008-c32e-40a1-b053-9984e3667b18" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:43:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-21d2ba7e-006c-4076-9edd-84a0a5932636 tempest-VolumesSnapshotListTestJSON-1739592163 None] Acquiring lock "cinder-quobyte-4072a7ae-bdcf-47b5-974d-c8d8c84e02d3" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:43:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-21d2ba7e-006c-4076-9edd-84a0a5932636 tempest-VolumesSnapshotListTestJSON-1739592163 None] Lock "cinder-quobyte-4072a7ae-bdcf-47b5-974d-c8d8c84e02d3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:43:39 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-21d2ba7e-006c-4076-9edd-84a0a5932636 tempest-VolumesSnapshotListTestJSON-1739592163 None] Deleting offline snapshot 4072a7ae-bdcf-47b5-974d-c8d8c84e02d3 of volume b08f3008-c32e-40a1-b053-9984e3667b18 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:43:39 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-21d2ba7e-006c-4076-9edd-84a0a5932636 tempest-VolumesSnapshotListTestJSON-1739592163 None] snapshot_file for this snap is: volume-b08f3008-c32e-40a1-b053-9984e3667b18.4072a7ae-bdcf-47b5-974d-c8d8c84e02d3 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:43:39 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc01adba-4d4e-4447-8788-e4581f75505a]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:43:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-21d2ba7e-006c-4076-9edd-84a0a5932636 tempest-VolumesSnapshotListTestJSON-1739592163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.4072a7ae-bdcf-47b5-974d-c8d8c84e02d3 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:39 devstack sudo[103486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.4072a7ae-bdcf-47b5-974d-c8d8c84e02d3 Jun 04 06:43:39 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:39 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-21d2ba7e-006c-4076-9edd-84a0a5932636 tempest-VolumesSnapshotListTestJSON-1739592163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.4072a7ae-bdcf-47b5-974d-c8d8c84e02d3" returned: 0 in 0.722s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:39 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-21d2ba7e-006c-4076-9edd-84a0a5932636 tempest-VolumesSnapshotListTestJSON-1739592163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b08f3008-c32e-40a1-b053-9984e3667b18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:43:39 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b65ab2a-dec9-410d-a747-a18bc4e17d8d]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:43:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-21d2ba7e-006c-4076-9edd-84a0a5932636 tempest-VolumesSnapshotListTestJSON-1739592163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:39 devstack sudo[103491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18 Jun 04 06:43:39 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:40 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-21d2ba7e-006c-4076-9edd-84a0a5932636 tempest-VolumesSnapshotListTestJSON-1739592163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18" returned: 0 in 0.702s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-21d2ba7e-006c-4076-9edd-84a0a5932636 tempest-VolumesSnapshotListTestJSON-1739592163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.4072a7ae-bdcf-47b5-974d-c8d8c84e02d3 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:40 devstack sudo[103496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.4072a7ae-bdcf-47b5-974d-c8d8c84e02d3 Jun 04 06:43:40 devstack sudo[103496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:41 devstack sudo[103496]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-21d2ba7e-006c-4076-9edd-84a0a5932636 tempest-VolumesSnapshotListTestJSON-1739592163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.4072a7ae-bdcf-47b5-974d-c8d8c84e02d3" returned: 0 in 0.700s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-21d2ba7e-006c-4076-9edd-84a0a5932636 tempest-VolumesSnapshotListTestJSON-1739592163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.4072a7ae-bdcf-47b5-974d-c8d8c84e02d3 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:41 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.4072a7ae-bdcf-47b5-974d-c8d8c84e02d3 Jun 04 06:43:41 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:41 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-21d2ba7e-006c-4076-9edd-84a0a5932636 tempest-VolumesSnapshotListTestJSON-1739592163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18.4072a7ae-bdcf-47b5-974d-c8d8c84e02d3" returned: 0 in 0.580s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:41 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-21d2ba7e-006c-4076-9edd-84a0a5932636 tempest-VolumesSnapshotListTestJSON-1739592163 None] Lock "cinder-quobyte-4072a7ae-bdcf-47b5-974d-c8d8c84e02d3" released by "_delete_snapshot" :: held 2.814s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:43:41 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-21d2ba7e-006c-4076-9edd-84a0a5932636 tempest-VolumesSnapshotListTestJSON-1739592163 None] Lock "cinder-quobyte-b08f3008-c32e-40a1-b053-9984e3667b18" released by "delete_snapshot" :: held 2.836s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:43:41 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-21d2ba7e-006c-4076-9edd-84a0a5932636 tempest-VolumesSnapshotListTestJSON-1739592163 None] Created reservations ['30c4b25f-8887-44d9-b4d7-f4291da918b3', 'cef96858-94cf-4bd3-b9c3-6a121dda23ee', '6814f9fc-1cd2-4773-ad98-753dcff5fe48', 'e27373ea-9639-4c5c-8dcb-d82c12e46815'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:43:41 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-21d2ba7e-006c-4076-9edd-84a0a5932636 tempest-VolumesSnapshotListTestJSON-1739592163 None] Delete snapshot completed successfully. Jun 04 06:43:41 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-21d2ba7e-006c-4076-9edd-84a0a5932636 tempest-VolumesSnapshotListTestJSON-1739592163 None] Lock "cinder-4072a7ae-bdcf-47b5-974d-c8d8c84e02d3-delete_snapshot" released by "delete_snapshot" :: held 2.965s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:43:42 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c36668fb-9c7f-4632-944a-de61e0927940 tempest-VolumesSnapshotListTestJSON-1739592163 None] Acquiring lock "cinder-b08f3008-c32e-40a1-b053-9984e3667b18-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:43:42 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c36668fb-9c7f-4632-944a-de61e0927940 tempest-VolumesSnapshotListTestJSON-1739592163 None] Lock "cinder-b08f3008-c32e-40a1-b053-9984e3667b18-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:43:42 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c36668fb-9c7f-4632-944a-de61e0927940 tempest-VolumesSnapshotListTestJSON-1739592163 None] Acquiring lock "cinder-quobyte-b08f3008-c32e-40a1-b053-9984e3667b18" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:43:42 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c36668fb-9c7f-4632-944a-de61e0927940 tempest-VolumesSnapshotListTestJSON-1739592163 None] Lock "cinder-quobyte-b08f3008-c32e-40a1-b053-9984e3667b18" acquired by "delete_volume" :: waited 0.014s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:43:42 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab818cf-3b54-4f53-a906-9f27145f0691]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:43:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c36668fb-9c7f-4632-944a-de61e0927940 tempest-VolumesSnapshotListTestJSON-1739592163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:42 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18 Jun 04 06:43:42 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:43 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c36668fb-9c7f-4632-944a-de61e0927940 tempest-VolumesSnapshotListTestJSON-1739592163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18" returned: 0 in 0.703s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c36668fb-9c7f-4632-944a-de61e0927940 tempest-VolumesSnapshotListTestJSON-1739592163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:43 devstack sudo[103509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18 Jun 04 06:43:43 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:43 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c36668fb-9c7f-4632-944a-de61e0927940 tempest-VolumesSnapshotListTestJSON-1739592163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b08f3008-c32e-40a1-b053-9984e3667b18" returned: 0 in 0.637s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:43 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c36668fb-9c7f-4632-944a-de61e0927940 tempest-VolumesSnapshotListTestJSON-1739592163 None] Lock "cinder-quobyte-b08f3008-c32e-40a1-b053-9984e3667b18" released by "delete_volume" :: held 1.400s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:43:43 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-c36668fb-9c7f-4632-944a-de61e0927940 tempest-VolumesSnapshotListTestJSON-1739592163 None] Created reservations ['0d582f83-dcc6-4c3a-bc40-a456c00bfdb9', '0c3752f3-cb7e-46d5-8fa9-e431686e11b4', 'daad200a-0e49-413e-a5fd-e3f53f61b14b', '4fb22671-2f06-4787-99db-2018e33297ec'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:43:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c36668fb-9c7f-4632-944a-de61e0927940 tempest-VolumesSnapshotListTestJSON-1739592163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:43:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c36668fb-9c7f-4632-944a-de61e0927940 tempest-VolumesSnapshotListTestJSON-1739592163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:43:43 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c36668fb-9c7f-4632-944a-de61e0927940 tempest-VolumesSnapshotListTestJSON-1739592163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:43:43 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c36668fb-9c7f-4632-944a-de61e0927940 tempest-VolumesSnapshotListTestJSON-1739592163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:43:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c36668fb-9c7f-4632-944a-de61e0927940 tempest-VolumesSnapshotListTestJSON-1739592163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:43:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c36668fb-9c7f-4632-944a-de61e0927940 tempest-VolumesSnapshotListTestJSON-1739592163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:43:43 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:43:43 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:43:44 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Jun 04 06:43:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c36668fb-9c7f-4632-944a-de61e0927940 tempest-VolumesSnapshotListTestJSON-1739592163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.614s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:43:44 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-c36668fb-9c7f-4632-944a-de61e0927940 tempest-VolumesSnapshotListTestJSON-1739592163 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:43:44 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-c36668fb-9c7f-4632-944a-de61e0927940 tempest-VolumesSnapshotListTestJSON-1739592163 None] Deleted volume successfully. Jun 04 06:43:44 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c36668fb-9c7f-4632-944a-de61e0927940 tempest-VolumesSnapshotListTestJSON-1739592163 None] Lock "cinder-b08f3008-c32e-40a1-b053-9984e3667b18-delete_volume" released by "delete_volume" :: held 2.232s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:43:53 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=45,cinder:UPDATE=38,cinder:INSERT=13,cinder:DELETE=3 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:43:54 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=38,cinder:UPDATE=43,cinder:INSERT=9,cinder:DELETE=3 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:44:05 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-8516f250-566c-43e8-95f4-7d8d41500d02 req-ce8bb867-b7d4-4e5b-94ab-e7ef009b1435 tempest-TestShelveInstance-372472869 None] Terminate volume connection completed successfully. Jun 04 06:44:05 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-8516f250-566c-43e8-95f4-7d8d41500d02 req-ce8bb867-b7d4-4e5b-94ab-e7ef009b1435 tempest-TestShelveInstance-372472869 None] Deleting attachment 6b17012c-fe37-4c3e-bdf7-4da4e4f3c3ad. {{(pid=86069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 06:44:05 devstack cinder-volume[86069]: DEBUG cinder.coordination [req-8516f250-566c-43e8-95f4-7d8d41500d02 req-ab1b37da-fe48-4780-8412-7d1fabcee75d tempest-TestShelveInstance-372472869 None] Acquiring lock "cinder-759dbd11-8266-4e77-b683-fe3930fb8389-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:44:05 devstack cinder-volume[86069]: DEBUG cinder.coordination [req-8516f250-566c-43e8-95f4-7d8d41500d02 req-ab1b37da-fe48-4780-8412-7d1fabcee75d tempest-TestShelveInstance-372472869 None] Lock "cinder-759dbd11-8266-4e77-b683-fe3930fb8389-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:44:05 devstack cinder-volume[86069]: DEBUG cinder.coordination [req-8516f250-566c-43e8-95f4-7d8d41500d02 req-ab1b37da-fe48-4780-8412-7d1fabcee75d tempest-TestShelveInstance-372472869 None] Acquiring lock "cinder-quobyte-759dbd11-8266-4e77-b683-fe3930fb8389" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:44:05 devstack cinder-volume[86069]: DEBUG cinder.coordination [req-8516f250-566c-43e8-95f4-7d8d41500d02 req-ab1b37da-fe48-4780-8412-7d1fabcee75d tempest-TestShelveInstance-372472869 None] Lock "cinder-quobyte-759dbd11-8266-4e77-b683-fe3930fb8389" acquired by "delete_volume" :: waited 0.018s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:44:05 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f120b2a7-b346-4e4d-8830-e01b7ead151c]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:44:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-8516f250-566c-43e8-95f4-7d8d41500d02 req-ab1b37da-fe48-4780-8412-7d1fabcee75d tempest-TestShelveInstance-372472869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:05 devstack sudo[103567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389 Jun 04 06:44:05 devstack sudo[103567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:06 devstack sudo[103567]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-8516f250-566c-43e8-95f4-7d8d41500d02 req-ab1b37da-fe48-4780-8412-7d1fabcee75d tempest-TestShelveInstance-372472869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389" returned: 0 in 0.756s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-8516f250-566c-43e8-95f4-7d8d41500d02 req-ab1b37da-fe48-4780-8412-7d1fabcee75d tempest-TestShelveInstance-372472869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:06 devstack sudo[103573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389 Jun 04 06:44:06 devstack sudo[103573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:07 devstack sudo[103573]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-8516f250-566c-43e8-95f4-7d8d41500d02 req-ab1b37da-fe48-4780-8412-7d1fabcee75d tempest-TestShelveInstance-372472869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389" returned: 1 in 0.726s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-8516f250-566c-43e8-95f4-7d8d41500d02 req-ab1b37da-fe48-4780-8412-7d1fabcee75d tempest-TestShelveInstance-372472869 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:44:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-8516f250-566c-43e8-95f4-7d8d41500d02 req-ab1b37da-fe48-4780-8412-7d1fabcee75d tempest-TestShelveInstance-372472869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:07 devstack sudo[103579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389 Jun 04 06:44:07 devstack sudo[103579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:07 devstack sudo[103579]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-8516f250-566c-43e8-95f4-7d8d41500d02 req-ab1b37da-fe48-4780-8412-7d1fabcee75d tempest-TestShelveInstance-372472869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-759dbd11-8266-4e77-b683-fe3930fb8389" returned: 0 in 0.583s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:07 devstack cinder-volume[86069]: DEBUG cinder.coordination [req-8516f250-566c-43e8-95f4-7d8d41500d02 req-ab1b37da-fe48-4780-8412-7d1fabcee75d tempest-TestShelveInstance-372472869 None] Lock "cinder-quobyte-759dbd11-8266-4e77-b683-fe3930fb8389" released by "delete_volume" :: held 2.139s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:44:08 devstack cinder-volume[86069]: DEBUG cinder.quota [req-8516f250-566c-43e8-95f4-7d8d41500d02 req-ab1b37da-fe48-4780-8412-7d1fabcee75d tempest-TestShelveInstance-372472869 None] Created reservations ['146b8b4d-4023-40cf-951f-f74e7b6a4744', '2f276a57-c774-43cc-9b6b-4e877e7ddd22', '7ca7ff67-a682-4de6-a4e6-ab23da584a57', '45b4cd1c-0380-4c29-a61c-88c100086a0b'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:44:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-8516f250-566c-43e8-95f4-7d8d41500d02 req-ab1b37da-fe48-4780-8412-7d1fabcee75d tempest-TestShelveInstance-372472869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:44:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-8516f250-566c-43e8-95f4-7d8d41500d02 req-ab1b37da-fe48-4780-8412-7d1fabcee75d tempest-TestShelveInstance-372472869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:44:08 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [req-8516f250-566c-43e8-95f4-7d8d41500d02 req-ab1b37da-fe48-4780-8412-7d1fabcee75d tempest-TestShelveInstance-372472869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:44:08 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [req-8516f250-566c-43e8-95f4-7d8d41500d02 req-ab1b37da-fe48-4780-8412-7d1fabcee75d tempest-TestShelveInstance-372472869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:44:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-8516f250-566c-43e8-95f4-7d8d41500d02 req-ab1b37da-fe48-4780-8412-7d1fabcee75d tempest-TestShelveInstance-372472869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:44:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-8516f250-566c-43e8-95f4-7d8d41500d02 req-ab1b37da-fe48-4780-8412-7d1fabcee75d tempest-TestShelveInstance-372472869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:08 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:44:08 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:08 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-8516f250-566c-43e8-95f4-7d8d41500d02 req-ab1b37da-fe48-4780-8412-7d1fabcee75d tempest-TestShelveInstance-372472869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.652s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:08 devstack cinder-volume[86069]: DEBUG cinder.manager [req-8516f250-566c-43e8-95f4-7d8d41500d02 req-ab1b37da-fe48-4780-8412-7d1fabcee75d tempest-TestShelveInstance-372472869 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:44:08 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-8516f250-566c-43e8-95f4-7d8d41500d02 req-ab1b37da-fe48-4780-8412-7d1fabcee75d tempest-TestShelveInstance-372472869 None] Deleted volume successfully. Jun 04 06:44:08 devstack cinder-volume[86069]: DEBUG cinder.coordination [req-8516f250-566c-43e8-95f4-7d8d41500d02 req-ab1b37da-fe48-4780-8412-7d1fabcee75d tempest-TestShelveInstance-372472869 None] Lock "cinder-759dbd11-8266-4e77-b683-fe3930fb8389-delete_volume" released by "delete_volume" :: held 2.993s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:44:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:44:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:44:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:44:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:44:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:44:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:44:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:11 devstack sudo[103586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:44:11 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:11 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.767s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:11 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:44:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager._thread_info {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:44:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread count: 28 {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 06:44:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread info: [<_MainThread(MainThread, started 131797370544256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 06:44:18 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=7,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:44:18 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:UPDATE=8,cinder:SELECT=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:44:21 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:44:21 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] Flow 'volume_create_manager' (58033a4a-bc4b-419c-9523-82d6d9db21fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:44:21 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec2c007d-ffd8-4bae-8103-bbb7990c5d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:21 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec2c007d-ffd8-4bae-8103-bbb7990c5d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1749571546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a96b1af0-dc39-45b8-b72e-cb0489bef5ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b86301259747a784da726c7be785b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:44:22Z,use_quota=True,user_id='1d03fa7804df4da684e6c3170111d48d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:21 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a99612b-d438-4cd0-8419-37ab35c02d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:21 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a99612b-d438-4cd0-8419-37ab35c02d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:21 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b0b2cfa-ddcc-4611-8fc9-96b4ea6355ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:21 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b0b2cfa-ddcc-4611-8fc9-96b4ea6355ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a96b1af0-dc39-45b8-b72e-cb0489bef5ce', 'volume_name': 'volume-a96b1af0-dc39-45b8-b72e-cb0489bef5ce', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:21 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (812c194d-2c99-4b99-a3cd-026d99eb3a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:21 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (812c194d-2c99-4b99-a3cd-026d99eb3a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:21 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58373ac9-2757-4655-8ea9-330ffa207083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:21 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] Volume a96b1af0-dc39-45b8-b72e-cb0489bef5ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a96b1af0-dc39-45b8-b72e-cb0489bef5ce', 'volume_size': 1} Jun 04 06:44:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:44:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:44:21 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1749571546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a96b1af0-dc39-45b8-b72e-cb0489bef5ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b86301259747a784da726c7be785b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:44:22Z,use_quota=True,user_id='1d03fa7804df4da684e6c3170111d48d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:44:21 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] Creating volume a96b1af0-dc39-45b8-b72e-cb0489bef5ce {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:44:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:44:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:44:21 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:44:21 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:44:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:44:21 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:44:21 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:44:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a96b1af0-dc39-45b8-b72e-cb0489bef5ce 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:21 devstack sudo[103692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a96b1af0-dc39-45b8-b72e-cb0489bef5ce 1073741824 Jun 04 06:44:21 devstack sudo[103692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:22 devstack sudo[103692]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a96b1af0-dc39-45b8-b72e-cb0489bef5ce 1073741824" returned: 0 in 0.905s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a96b1af0-dc39-45b8-b72e-cb0489bef5ce {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:22 devstack sudo[103698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a96b1af0-dc39-45b8-b72e-cb0489bef5ce Jun 04 06:44:22 devstack sudo[103698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] Flow 'volume_create_manager' (3b1b99c9-1b02-41d3-af94-f0ee22ce8fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc6a5f2-d340-48a6-a161-e3dd50383f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc6a5f2-d340-48a6-a161-e3dd50383f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1998310391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=688e55f9-9ef6-4b30-bf8a-0fa1c5005e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0131c9526cd54607b4a8ad0d0398c3cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:44:23Z,use_quota=True,user_id='052d997b24a642e582a9993a3b9b1750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (286d6135-74ee-4e76-8d2a-df7284d01dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (286d6135-74ee-4e76-8d2a-df7284d01dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abcb09be-8a26-4332-89e1-6e8c2cf098d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abcb09be-8a26-4332-89e1-6e8c2cf098d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '688e55f9-9ef6-4b30-bf8a-0fa1c5005e4f', 'volume_name': 'volume-688e55f9-9ef6-4b30-bf8a-0fa1c5005e4f', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ca0c4ee-7272-4eb6-b931-1a4e7905bfdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ca0c4ee-7272-4eb6-b931-1a4e7905bfdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c72188-433a-4a80-91ac-b1a6f6a70496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:23 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] Volume 688e55f9-9ef6-4b30-bf8a-0fa1c5005e4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-688e55f9-9ef6-4b30-bf8a-0fa1c5005e4f', 'volume_size': 1} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:44:23 devstack sudo[103698]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a96b1af0-dc39-45b8-b72e-cb0489bef5ce" returned: 0 in 0.676s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.188s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1998310391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=688e55f9-9ef6-4b30-bf8a-0fa1c5005e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0131c9526cd54607b4a8ad0d0398c3cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:44:23Z,use_quota=True,user_id='052d997b24a642e582a9993a3b9b1750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] Creating volume 688e55f9-9ef6-4b30-bf8a-0fa1c5005e4f {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:44:23 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-688e55f9-9ef6-4b30-bf8a-0fa1c5005e4f 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58373ac9-2757-4655-8ea9-330ffa207083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a96b1af0-dc39-45b8-b72e-cb0489bef5ce', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4581268e-ff19-4f8b-ac0e-49e17ed6b8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:23 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] Volume volume-a96b1af0-dc39-45b8-b72e-cb0489bef5ce (a96b1af0-dc39-45b8-b72e-cb0489bef5ce): created successfully Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4581268e-ff19-4f8b-ac0e-49e17ed6b8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:23 devstack sudo[103702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-688e55f9-9ef6-4b30-bf8a-0fa1c5005e4f 1073741824 Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] Flow 'volume_create_manager' (58033a4a-bc4b-419c-9523-82d6d9db21fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:44:23 devstack sudo[103702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:23 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-cad3d53e-cc46-43cc-b941-f46e9bbb1f5f tempest-TestMinimumBasicScenario-1577532672 None] Created volume successfully. Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] Flow 'volume_create_manager' (27d13ab0-bcb3-42d1-8e7b-21245dd4fd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd0f8ec-b799-4356-b8e8-308f9e2482cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd0f8ec-b799-4356-b8e8-308f9e2482cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1932390829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0ec2340-841d-4a7e-9ca9-bf27b829e98b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0131c9526cd54607b4a8ad0d0398c3cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:44:23Z,use_quota=True,user_id='052d997b24a642e582a9993a3b9b1750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c785f47b-7c51-4fef-b0d6-e90dbe1e25fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c785f47b-7c51-4fef-b0d6-e90dbe1e25fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ed801b-98b1-4bc3-b532-4eba4c6c8e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ed801b-98b1-4bc3-b532-4eba4c6c8e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0ec2340-841d-4a7e-9ca9-bf27b829e98b', 'volume_name': 'volume-d0ec2340-841d-4a7e-9ca9-bf27b829e98b', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5efbeae8-faeb-46cb-b936-ae98367af4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5efbeae8-faeb-46cb-b936-ae98367af4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09fbbdca-7d17-49aa-acbf-19009fe8a9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:23 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] Volume d0ec2340-841d-4a7e-9ca9-bf27b829e98b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0ec2340-841d-4a7e-9ca9-bf27b829e98b', 'volume_size': 1} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:44:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] Flow 'volume_create_manager' (4a6ccea1-42f0-464c-a1bf-45fd7e531e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:44:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cda9117-fa5d-4502-984a-0ed02c35d6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cda9117-fa5d-4502-984a-0ed02c35d6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1960751980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=761c72d4-29bd-44c1-b908-3174884ba2fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0131c9526cd54607b4a8ad0d0398c3cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:44:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:44:24Z,use_quota=True,user_id='052d997b24a642e582a9993a3b9b1750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1eac122-4b01-495d-a370-615a00b81278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1eac122-4b01-495d-a370-615a00b81278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a86fa87c-bf5e-4c2d-b2d4-01655c0e9f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a86fa87c-bf5e-4c2d-b2d4-01655c0e9f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '761c72d4-29bd-44c1-b908-3174884ba2fd', 'volume_name': 'volume-761c72d4-29bd-44c1-b908-3174884ba2fd', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00338018-5b1b-42e4-bf7e-dfef1bd89e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00338018-5b1b-42e4-bf7e-dfef1bd89e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ec44484-6124-413e-a824-7033ec24061c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:24 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] Volume 761c72d4-29bd-44c1-b908-3174884ba2fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-761c72d4-29bd-44c1-b908-3174884ba2fd', 'volume_size': 1} Jun 04 06:44:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:44:24 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:44:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] Flow 'volume_create_manager' (304954f8-0ebf-41ed-88ee-63eb0f704680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:44:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b0720be-947b-47f6-90ec-31231a33b202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b0720be-947b-47f6-90ec-31231a33b202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-839783998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3868748-f186-4b1f-a1d3-71815557752a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0131c9526cd54607b4a8ad0d0398c3cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:44:25Z,use_quota=True,user_id='052d997b24a642e582a9993a3b9b1750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c94bb8e3-55f6-4b7c-9609-cf91b76658f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c94bb8e3-55f6-4b7c-9609-cf91b76658f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cfaace6-992b-4a28-b08d-34b2f9a92202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cfaace6-992b-4a28-b08d-34b2f9a92202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3868748-f186-4b1f-a1d3-71815557752a', 'volume_name': 'volume-b3868748-f186-4b1f-a1d3-71815557752a', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e6a43be-b179-46d6-8615-49b0415a9c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e6a43be-b179-46d6-8615-49b0415a9c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa95429-8b23-446e-9d21-45f509dcb2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:24 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] Volume b3868748-f186-4b1f-a1d3-71815557752a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3868748-f186-4b1f-a1d3-71815557752a', 'volume_size': 1} Jun 04 06:44:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:44:24 devstack sudo[103702]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-688e55f9-9ef6-4b30-bf8a-0fa1c5005e4f 1073741824" returned: 0 in 1.329s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-688e55f9-9ef6-4b30-bf8a-0fa1c5005e4f {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:24 devstack sudo[103708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-688e55f9-9ef6-4b30-bf8a-0fa1c5005e4f Jun 04 06:44:24 devstack sudo[103708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:25 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:44:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] Flow 'volume_create_manager' (de297454-e64d-4459-82d8-73140c330921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:44:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31076a38-8102-44d4-8339-2cf5551972b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31076a38-8102-44d4-8339-2cf5551972b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1323929638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c316811a-cc35-491f-a2ef-16f543f7e293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0131c9526cd54607b4a8ad0d0398c3cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:44:25Z,use_quota=True,user_id='052d997b24a642e582a9993a3b9b1750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3afaef13-65db-47b1-a1ed-a2627bd7af55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3afaef13-65db-47b1-a1ed-a2627bd7af55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a59bda-de2c-47a2-9579-7db1218ca43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a59bda-de2c-47a2-9579-7db1218ca43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c316811a-cc35-491f-a2ef-16f543f7e293', 'volume_name': 'volume-c316811a-cc35-491f-a2ef-16f543f7e293', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef7ce175-0eb6-48fb-ac95-8991d49e29a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef7ce175-0eb6-48fb-ac95-8991d49e29a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b8d03e9-fc2d-4320-bad8-e35596fb5265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:25 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] Volume c316811a-cc35-491f-a2ef-16f543f7e293: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c316811a-cc35-491f-a2ef-16f543f7e293', 'volume_size': 1} Jun 04 06:44:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:44:25 devstack sudo[103708]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-688e55f9-9ef6-4b30-bf8a-0fa1c5005e4f" returned: 0 in 0.624s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:25 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] <== create_volume: return (2015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:44:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.018s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:44:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.726s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:44:25 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1932390829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0ec2340-841d-4a7e-9ca9-bf27b829e98b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0131c9526cd54607b4a8ad0d0398c3cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:44:23Z,use_quota=True,user_id='052d997b24a642e582a9993a3b9b1750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:44:25 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] Creating volume d0ec2340-841d-4a7e-9ca9-bf27b829e98b {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:44:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:44:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:44:25 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:44:25 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:44:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:44:25 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:44:25 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:44:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d0ec2340-841d-4a7e-9ca9-bf27b829e98b 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:25 devstack sudo[103711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d0ec2340-841d-4a7e-9ca9-bf27b829e98b 1073741824 Jun 04 06:44:25 devstack sudo[103711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c72188-433a-4a80-91ac-b1a6f6a70496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-688e55f9-9ef6-4b30-bf8a-0fa1c5005e4f', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fc2dce3-bb3d-4e76-830b-76b6dd97b03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:25 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] Volume volume-688e55f9-9ef6-4b30-bf8a-0fa1c5005e4f (688e55f9-9ef6-4b30-bf8a-0fa1c5005e4f): created successfully Jun 04 06:44:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fc2dce3-bb3d-4e76-830b-76b6dd97b03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] Flow 'volume_create_manager' (3b1b99c9-1b02-41d3-af94-f0ee22ce8fa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:44:25 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-0b23adf4-2613-47ad-b7a0-77cccaefaf31 tempest-CreateVolumesFromImageTest-948938234 None] Created volume successfully. Jun 04 06:44:26 devstack sudo[103711]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d0ec2340-841d-4a7e-9ca9-bf27b829e98b 1073741824" returned: 0 in 0.918s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d0ec2340-841d-4a7e-9ca9-bf27b829e98b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:26 devstack sudo[103716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d0ec2340-841d-4a7e-9ca9-bf27b829e98b Jun 04 06:44:26 devstack sudo[103716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:26 devstack sudo[103716]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d0ec2340-841d-4a7e-9ca9-bf27b829e98b" returned: 0 in 0.598s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:26 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:44:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:44:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.926s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:44:26 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1960751980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=761c72d4-29bd-44c1-b908-3174884ba2fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0131c9526cd54607b4a8ad0d0398c3cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:44:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:44:24Z,use_quota=True,user_id='052d997b24a642e582a9993a3b9b1750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:44:26 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] Creating volume 761c72d4-29bd-44c1-b908-3174884ba2fd {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:44:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:44:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:44:26 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:44:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:44:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:44:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:44:27 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:44:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-761c72d4-29bd-44c1-b908-3174884ba2fd 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:27 devstack sudo[103719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-761c72d4-29bd-44c1-b908-3174884ba2fd 1073741824 Jun 04 06:44:27 devstack sudo[103719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09fbbdca-7d17-49aa-acbf-19009fe8a9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0ec2340-841d-4a7e-9ca9-bf27b829e98b', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb5765e-52b5-4b32-a0bd-f067161f0530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:27 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] Volume volume-d0ec2340-841d-4a7e-9ca9-bf27b829e98b (d0ec2340-841d-4a7e-9ca9-bf27b829e98b): created successfully Jun 04 06:44:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb5765e-52b5-4b32-a0bd-f067161f0530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] Flow 'volume_create_manager' (27d13ab0-bcb3-42d1-8e7b-21245dd4fd5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:44:27 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-60d51457-ace5-4b50-8a61-ea6b4cafd044 tempest-CreateVolumesFromImageTest-948938234 None] Created volume successfully. Jun 04 06:44:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-56fa1f90-1cd9-4314-92a8-9ae0a638dcac req-c4a6d417-d985-4d16-9d43-27c4642e08aa tempest-TestMinimumBasicScenario-1577532672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:44:27 devstack sudo[103719]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-761c72d4-29bd-44c1-b908-3174884ba2fd 1073741824" returned: 0 in 0.793s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-761c72d4-29bd-44c1-b908-3174884ba2fd {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:27 devstack sudo[103733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-761c72d4-29bd-44c1-b908-3174884ba2fd Jun 04 06:44:27 devstack sudo[103733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:28 devstack sudo[103733]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-761c72d4-29bd-44c1-b908-3174884ba2fd" returned: 0 in 0.617s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:28 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:44:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:44:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.793s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:44:28 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-839783998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3868748-f186-4b1f-a1d3-71815557752a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0131c9526cd54607b4a8ad0d0398c3cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:44:25Z,use_quota=True,user_id='052d997b24a642e582a9993a3b9b1750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:44:28 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] Creating volume b3868748-f186-4b1f-a1d3-71815557752a {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:44:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:44:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:44:28 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:44:28 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:44:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:44:28 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:44:28 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:44:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b3868748-f186-4b1f-a1d3-71815557752a 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ec44484-6124-413e-a824-7033ec24061c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-761c72d4-29bd-44c1-b908-3174884ba2fd', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:28 devstack sudo[103736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b3868748-f186-4b1f-a1d3-71815557752a 1073741824 Jun 04 06:44:28 devstack sudo[103736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (269def8f-6bf0-44a0-9fa4-4dcdef467b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:28 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] Volume volume-761c72d4-29bd-44c1-b908-3174884ba2fd (761c72d4-29bd-44c1-b908-3174884ba2fd): created successfully Jun 04 06:44:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (269def8f-6bf0-44a0-9fa4-4dcdef467b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] Flow 'volume_create_manager' (4a6ccea1-42f0-464c-a1bf-45fd7e531e3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:44:28 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-55d8fcf6-a1ba-474b-9cf4-8fc890c55acf tempest-CreateVolumesFromImageTest-948938234 None] Created volume successfully. Jun 04 06:44:29 devstack sudo[103736]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b3868748-f186-4b1f-a1d3-71815557752a 1073741824" returned: 0 in 0.862s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b3868748-f186-4b1f-a1d3-71815557752a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:29 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b3868748-f186-4b1f-a1d3-71815557752a Jun 04 06:44:29 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:30 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b3868748-f186-4b1f-a1d3-71815557752a" returned: 0 in 0.670s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:44:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:44:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.967s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:44:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1323929638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c316811a-cc35-491f-a2ef-16f543f7e293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0131c9526cd54607b4a8ad0d0398c3cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:44:25Z,use_quota=True,user_id='052d997b24a642e582a9993a3b9b1750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:44:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] Creating volume c316811a-cc35-491f-a2ef-16f543f7e293 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:44:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:44:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:44:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:44:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:44:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:44:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:44:30 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:44:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c316811a-cc35-491f-a2ef-16f543f7e293 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:30 devstack sudo[103744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c316811a-cc35-491f-a2ef-16f543f7e293 1073741824 Jun 04 06:44:30 devstack sudo[103744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa95429-8b23-446e-9d21-45f509dcb2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3868748-f186-4b1f-a1d3-71815557752a', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf56ccb-93e0-4198-90c3-246365c355ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:30 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] Volume volume-b3868748-f186-4b1f-a1d3-71815557752a (b3868748-f186-4b1f-a1d3-71815557752a): created successfully Jun 04 06:44:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf56ccb-93e0-4198-90c3-246365c355ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] Flow 'volume_create_manager' (304954f8-0ebf-41ed-88ee-63eb0f704680) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:44:30 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-e467cb16-0c67-4275-8153-9d27e67345b8 tempest-CreateVolumesFromImageTest-948938234 None] Created volume successfully. Jun 04 06:44:30 devstack sudo[103744]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c316811a-cc35-491f-a2ef-16f543f7e293 1073741824" returned: 0 in 0.833s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c316811a-cc35-491f-a2ef-16f543f7e293 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:31 devstack sudo[103761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c316811a-cc35-491f-a2ef-16f543f7e293 Jun 04 06:44:31 devstack sudo[103761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:31 devstack sudo[103761]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c316811a-cc35-491f-a2ef-16f543f7e293" returned: 0 in 0.670s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:31 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:44:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:44:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-56fa1f90-1cd9-4314-92a8-9ae0a638dcac req-c4a6d417-d985-4d16-9d43-27c4642e08aa tempest-TestMinimumBasicScenario-1577532672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.201s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:44:31 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b8d03e9-fc2d-4320-bad8-e35596fb5265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c316811a-cc35-491f-a2ef-16f543f7e293', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:31 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d195af5-e6ac-4ae5-99c3-ca43ddd4d839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:31 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f91b288-b484-47ea-bd13-92ee6ad0a6b0]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:44:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-56fa1f90-1cd9-4314-92a8-9ae0a638dcac req-c4a6d417-d985-4d16-9d43-27c4642e08aa tempest-TestMinimumBasicScenario-1577532672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a96b1af0-dc39-45b8-b72e-cb0489bef5ce {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:31 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] Volume volume-c316811a-cc35-491f-a2ef-16f543f7e293 (c316811a-cc35-491f-a2ef-16f543f7e293): created successfully Jun 04 06:44:31 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d195af5-e6ac-4ae5-99c3-ca43ddd4d839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:31 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] Flow 'volume_create_manager' (de297454-e64d-4459-82d8-73140c330921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:44:31 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-a01e6b61-1af7-4222-8b2e-a0bec52c10cc tempest-CreateVolumesFromImageTest-948938234 None] Created volume successfully. Jun 04 06:44:31 devstack sudo[103768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a96b1af0-dc39-45b8-b72e-cb0489bef5ce Jun 04 06:44:31 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:32 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-56fa1f90-1cd9-4314-92a8-9ae0a638dcac req-c4a6d417-d985-4d16-9d43-27c4642e08aa tempest-TestMinimumBasicScenario-1577532672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a96b1af0-dc39-45b8-b72e-cb0489bef5ce" returned: 0 in 0.749s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-56fa1f90-1cd9-4314-92a8-9ae0a638dcac req-c4a6d417-d985-4d16-9d43-27c4642e08aa tempest-TestMinimumBasicScenario-1577532672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.778s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:44:32 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-56fa1f90-1cd9-4314-92a8-9ae0a638dcac req-c4a6d417-d985-4d16-9d43-27c4642e08aa tempest-TestMinimumBasicScenario-1577532672 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574', 'name': 'volume-a96b1af0-dc39-45b8-b72e-cb0489bef5ce', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fbd4a0e3-d782-48f1-ac54-c99999eda32b', 'enforce_multipath': True} {{(pid=86069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 06:44:32 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-56fa1f90-1cd9-4314-92a8-9ae0a638dcac req-c4a6d417-d985-4d16-9d43-27c4642e08aa tempest-TestMinimumBasicScenario-1577532672 None] attachment_update completed successfully. Jun 04 06:44:32 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-5af1a63b-a190-4bdf-84fb-b111bcffb994 tempest-CreateVolumesFromImageTest-948938234 None] Acquiring lock "cinder-c316811a-cc35-491f-a2ef-16f543f7e293-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:44:32 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-5af1a63b-a190-4bdf-84fb-b111bcffb994 tempest-CreateVolumesFromImageTest-948938234 None] Lock "cinder-c316811a-cc35-491f-a2ef-16f543f7e293-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:44:32 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-5af1a63b-a190-4bdf-84fb-b111bcffb994 tempest-CreateVolumesFromImageTest-948938234 None] Acquiring lock "cinder-quobyte-c316811a-cc35-491f-a2ef-16f543f7e293" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:44:32 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-5af1a63b-a190-4bdf-84fb-b111bcffb994 tempest-CreateVolumesFromImageTest-948938234 None] Lock "cinder-quobyte-c316811a-cc35-491f-a2ef-16f543f7e293" acquired by "delete_volume" :: waited 0.015s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:44:32 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[19471c71-b503-4e89-8b10-8afb61639d8e]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:44:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5af1a63b-a190-4bdf-84fb-b111bcffb994 tempest-CreateVolumesFromImageTest-948938234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c316811a-cc35-491f-a2ef-16f543f7e293 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:33 devstack sudo[103773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c316811a-cc35-491f-a2ef-16f543f7e293 Jun 04 06:44:33 devstack sudo[103773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:33 devstack sudo[103773]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5af1a63b-a190-4bdf-84fb-b111bcffb994 tempest-CreateVolumesFromImageTest-948938234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c316811a-cc35-491f-a2ef-16f543f7e293" returned: 0 in 0.769s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5af1a63b-a190-4bdf-84fb-b111bcffb994 tempest-CreateVolumesFromImageTest-948938234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c316811a-cc35-491f-a2ef-16f543f7e293 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:33 devstack sudo[103845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c316811a-cc35-491f-a2ef-16f543f7e293 Jun 04 06:44:33 devstack sudo[103845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:34 devstack sudo[103845]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5af1a63b-a190-4bdf-84fb-b111bcffb994 tempest-CreateVolumesFromImageTest-948938234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c316811a-cc35-491f-a2ef-16f543f7e293" returned: 0 in 0.638s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-5af1a63b-a190-4bdf-84fb-b111bcffb994 tempest-CreateVolumesFromImageTest-948938234 None] Lock "cinder-quobyte-c316811a-cc35-491f-a2ef-16f543f7e293" released by "delete_volume" :: held 1.449s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:44:34 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-5af1a63b-a190-4bdf-84fb-b111bcffb994 tempest-CreateVolumesFromImageTest-948938234 None] Created reservations ['8690259a-752d-4740-9c89-4620b4857de2', '3a782b41-9e85-4040-9c8f-e31ca38a1fd8', '8097b4ee-a1ad-4d11-bd08-35c4763d0fb3', 'fae6935e-c61e-43d0-b079-032ac559eefb'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:44:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5af1a63b-a190-4bdf-84fb-b111bcffb994 tempest-CreateVolumesFromImageTest-948938234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:44:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5af1a63b-a190-4bdf-84fb-b111bcffb994 tempest-CreateVolumesFromImageTest-948938234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:44:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5af1a63b-a190-4bdf-84fb-b111bcffb994 tempest-CreateVolumesFromImageTest-948938234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:44:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5af1a63b-a190-4bdf-84fb-b111bcffb994 tempest-CreateVolumesFromImageTest-948938234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:44:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5af1a63b-a190-4bdf-84fb-b111bcffb994 tempest-CreateVolumesFromImageTest-948938234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:44:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5af1a63b-a190-4bdf-84fb-b111bcffb994 tempest-CreateVolumesFromImageTest-948938234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:34 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:44:34 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:35 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7a0990da-6574-4774-bef0-553d6a87cc94 tempest-CreateVolumesFromImageTest-948938234 None] Acquiring lock "cinder-b3868748-f186-4b1f-a1d3-71815557752a-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:44:35 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7a0990da-6574-4774-bef0-553d6a87cc94 tempest-CreateVolumesFromImageTest-948938234 None] Lock "cinder-b3868748-f186-4b1f-a1d3-71815557752a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:44:35 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5af1a63b-a190-4bdf-84fb-b111bcffb994 tempest-CreateVolumesFromImageTest-948938234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.633s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:35 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-5af1a63b-a190-4bdf-84fb-b111bcffb994 tempest-CreateVolumesFromImageTest-948938234 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:44:35 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-5af1a63b-a190-4bdf-84fb-b111bcffb994 tempest-CreateVolumesFromImageTest-948938234 None] Deleted volume successfully. Jun 04 06:44:35 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7a0990da-6574-4774-bef0-553d6a87cc94 tempest-CreateVolumesFromImageTest-948938234 None] Acquiring lock "cinder-quobyte-b3868748-f186-4b1f-a1d3-71815557752a" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:44:35 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-5af1a63b-a190-4bdf-84fb-b111bcffb994 tempest-CreateVolumesFromImageTest-948938234 None] Lock "cinder-c316811a-cc35-491f-a2ef-16f543f7e293-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:44:35 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7a0990da-6574-4774-bef0-553d6a87cc94 tempest-CreateVolumesFromImageTest-948938234 None] Lock "cinder-quobyte-b3868748-f186-4b1f-a1d3-71815557752a" acquired by "delete_volume" :: waited 0.016s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:44:35 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[8858573c-f2f2-48f7-aae4-1e0160cf7f5a]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:44:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7a0990da-6574-4774-bef0-553d6a87cc94 tempest-CreateVolumesFromImageTest-948938234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b3868748-f186-4b1f-a1d3-71815557752a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:35 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b3868748-f186-4b1f-a1d3-71815557752a Jun 04 06:44:35 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:35 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7a0990da-6574-4774-bef0-553d6a87cc94 tempest-CreateVolumesFromImageTest-948938234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b3868748-f186-4b1f-a1d3-71815557752a" returned: 0 in 0.678s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7a0990da-6574-4774-bef0-553d6a87cc94 tempest-CreateVolumesFromImageTest-948938234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b3868748-f186-4b1f-a1d3-71815557752a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:35 devstack sudo[104213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b3868748-f186-4b1f-a1d3-71815557752a Jun 04 06:44:35 devstack sudo[104213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:36 devstack sudo[104213]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7a0990da-6574-4774-bef0-553d6a87cc94 tempest-CreateVolumesFromImageTest-948938234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b3868748-f186-4b1f-a1d3-71815557752a" returned: 0 in 0.569s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:36 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7a0990da-6574-4774-bef0-553d6a87cc94 tempest-CreateVolumesFromImageTest-948938234 None] Lock "cinder-quobyte-b3868748-f186-4b1f-a1d3-71815557752a" released by "delete_volume" :: held 1.284s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:44:36 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-7a0990da-6574-4774-bef0-553d6a87cc94 tempest-CreateVolumesFromImageTest-948938234 None] Created reservations ['3d942768-e8a9-4ecc-9039-081f338202ae', '1c19456a-a164-4c51-829b-187e588fe40a', '6e5a2b0d-12ad-4084-bfc3-acf7781ec906', '75fee561-c828-4c5b-971f-1f6927b20a47'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:44:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7a0990da-6574-4774-bef0-553d6a87cc94 tempest-CreateVolumesFromImageTest-948938234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:44:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7a0990da-6574-4774-bef0-553d6a87cc94 tempest-CreateVolumesFromImageTest-948938234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:44:36 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7a0990da-6574-4774-bef0-553d6a87cc94 tempest-CreateVolumesFromImageTest-948938234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:44:36 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7a0990da-6574-4774-bef0-553d6a87cc94 tempest-CreateVolumesFromImageTest-948938234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:44:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7a0990da-6574-4774-bef0-553d6a87cc94 tempest-CreateVolumesFromImageTest-948938234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:44:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7a0990da-6574-4774-bef0-553d6a87cc94 tempest-CreateVolumesFromImageTest-948938234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:36 devstack sudo[104216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:44:36 devstack sudo[104216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:37 devstack sudo[104216]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7a0990da-6574-4774-bef0-553d6a87cc94 tempest-CreateVolumesFromImageTest-948938234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.619s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:37 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-7a0990da-6574-4774-bef0-553d6a87cc94 tempest-CreateVolumesFromImageTest-948938234 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:44:37 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-7a0990da-6574-4774-bef0-553d6a87cc94 tempest-CreateVolumesFromImageTest-948938234 None] Deleted volume successfully. Jun 04 06:44:37 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7a0990da-6574-4774-bef0-553d6a87cc94 tempest-CreateVolumesFromImageTest-948938234 None] Lock "cinder-b3868748-f186-4b1f-a1d3-71815557752a-delete_volume" released by "delete_volume" :: held 2.125s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:44:37 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4b107b94-6f5f-498e-9114-98c011ee9db6 tempest-CreateVolumesFromImageTest-948938234 None] Acquiring lock "cinder-761c72d4-29bd-44c1-b908-3174884ba2fd-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:44:37 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4b107b94-6f5f-498e-9114-98c011ee9db6 tempest-CreateVolumesFromImageTest-948938234 None] Lock "cinder-761c72d4-29bd-44c1-b908-3174884ba2fd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:44:37 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4b107b94-6f5f-498e-9114-98c011ee9db6 tempest-CreateVolumesFromImageTest-948938234 None] Acquiring lock "cinder-quobyte-761c72d4-29bd-44c1-b908-3174884ba2fd" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:44:37 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4b107b94-6f5f-498e-9114-98c011ee9db6 tempest-CreateVolumesFromImageTest-948938234 None] Lock "cinder-quobyte-761c72d4-29bd-44c1-b908-3174884ba2fd" acquired by "delete_volume" :: waited 0.016s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:44:37 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b872057-5c7c-43b7-8140-119481073b4e]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:44:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4b107b94-6f5f-498e-9114-98c011ee9db6 tempest-CreateVolumesFromImageTest-948938234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-761c72d4-29bd-44c1-b908-3174884ba2fd {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:37 devstack sudo[104220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-761c72d4-29bd-44c1-b908-3174884ba2fd Jun 04 06:44:37 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:38 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4b107b94-6f5f-498e-9114-98c011ee9db6 tempest-CreateVolumesFromImageTest-948938234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-761c72d4-29bd-44c1-b908-3174884ba2fd" returned: 0 in 0.729s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4b107b94-6f5f-498e-9114-98c011ee9db6 tempest-CreateVolumesFromImageTest-948938234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-761c72d4-29bd-44c1-b908-3174884ba2fd {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:38 devstack sudo[104225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-761c72d4-29bd-44c1-b908-3174884ba2fd Jun 04 06:44:38 devstack sudo[104225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:38 devstack sudo[104225]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4b107b94-6f5f-498e-9114-98c011ee9db6 tempest-CreateVolumesFromImageTest-948938234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-761c72d4-29bd-44c1-b908-3174884ba2fd" returned: 0 in 0.690s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:38 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4b107b94-6f5f-498e-9114-98c011ee9db6 tempest-CreateVolumesFromImageTest-948938234 None] Lock "cinder-quobyte-761c72d4-29bd-44c1-b908-3174884ba2fd" released by "delete_volume" :: held 1.476s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:44:38 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-4b107b94-6f5f-498e-9114-98c011ee9db6 tempest-CreateVolumesFromImageTest-948938234 None] Created reservations ['9cc42916-47ea-4457-a7e2-c1d3868c80c5', '6e8a1479-adb0-45d4-97bc-13daf7585edb', '318b5e27-5308-4558-bca7-03f405a66087', '1b338943-b4ad-4a6b-9201-bb95ccd8eafc'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:44:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-4b107b94-6f5f-498e-9114-98c011ee9db6 tempest-CreateVolumesFromImageTest-948938234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:44:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-4b107b94-6f5f-498e-9114-98c011ee9db6 tempest-CreateVolumesFromImageTest-948938234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:44:38 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-4b107b94-6f5f-498e-9114-98c011ee9db6 tempest-CreateVolumesFromImageTest-948938234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:44:39 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-4b107b94-6f5f-498e-9114-98c011ee9db6 tempest-CreateVolumesFromImageTest-948938234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:44:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-4b107b94-6f5f-498e-9114-98c011ee9db6 tempest-CreateVolumesFromImageTest-948938234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:44:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4b107b94-6f5f-498e-9114-98c011ee9db6 tempest-CreateVolumesFromImageTest-948938234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:39 devstack sudo[104228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:44:39 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-b0515fe9-8dc5-421e-8a07-02af4df1f51f tempest-CreateVolumesFromImageTest-948938234 None] Acquiring lock "cinder-d0ec2340-841d-4a7e-9ca9-bf27b829e98b-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:44:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-b0515fe9-8dc5-421e-8a07-02af4df1f51f tempest-CreateVolumesFromImageTest-948938234 None] Lock "cinder-d0ec2340-841d-4a7e-9ca9-bf27b829e98b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:44:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-b0515fe9-8dc5-421e-8a07-02af4df1f51f tempest-CreateVolumesFromImageTest-948938234 None] Acquiring lock "cinder-quobyte-d0ec2340-841d-4a7e-9ca9-bf27b829e98b" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:44:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-b0515fe9-8dc5-421e-8a07-02af4df1f51f tempest-CreateVolumesFromImageTest-948938234 None] Lock "cinder-quobyte-d0ec2340-841d-4a7e-9ca9-bf27b829e98b" acquired by "delete_volume" :: waited 0.020s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:44:39 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1153c0-0b00-4622-933c-af2ab31c5ffa]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:44:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b0515fe9-8dc5-421e-8a07-02af4df1f51f tempest-CreateVolumesFromImageTest-948938234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d0ec2340-841d-4a7e-9ca9-bf27b829e98b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:39 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4b107b94-6f5f-498e-9114-98c011ee9db6 tempest-CreateVolumesFromImageTest-948938234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.747s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:39 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-4b107b94-6f5f-498e-9114-98c011ee9db6 tempest-CreateVolumesFromImageTest-948938234 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:44:39 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-4b107b94-6f5f-498e-9114-98c011ee9db6 tempest-CreateVolumesFromImageTest-948938234 None] Deleted volume successfully. Jun 04 06:44:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-4b107b94-6f5f-498e-9114-98c011ee9db6 tempest-CreateVolumesFromImageTest-948938234 None] Lock "cinder-761c72d4-29bd-44c1-b908-3174884ba2fd-delete_volume" released by "delete_volume" :: held 2.515s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:44:39 devstack sudo[104237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d0ec2340-841d-4a7e-9ca9-bf27b829e98b Jun 04 06:44:39 devstack sudo[104237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:40 devstack sudo[104237]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b0515fe9-8dc5-421e-8a07-02af4df1f51f tempest-CreateVolumesFromImageTest-948938234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d0ec2340-841d-4a7e-9ca9-bf27b829e98b" returned: 0 in 0.877s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b0515fe9-8dc5-421e-8a07-02af4df1f51f tempest-CreateVolumesFromImageTest-948938234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d0ec2340-841d-4a7e-9ca9-bf27b829e98b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:40 devstack sudo[104243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d0ec2340-841d-4a7e-9ca9-bf27b829e98b Jun 04 06:44:40 devstack sudo[104243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:41 devstack sudo[104243]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b0515fe9-8dc5-421e-8a07-02af4df1f51f tempest-CreateVolumesFromImageTest-948938234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-d0ec2340-841d-4a7e-9ca9-bf27b829e98b" returned: 0 in 0.718s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:41 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-b0515fe9-8dc5-421e-8a07-02af4df1f51f tempest-CreateVolumesFromImageTest-948938234 None] Lock "cinder-quobyte-d0ec2340-841d-4a7e-9ca9-bf27b829e98b" released by "delete_volume" :: held 1.675s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:44:41 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-b0515fe9-8dc5-421e-8a07-02af4df1f51f tempest-CreateVolumesFromImageTest-948938234 None] Created reservations ['1552cd5f-091f-4fc5-a328-8256e994e506', '5407826d-79f5-46c5-8f0e-7aa91d6703f3', 'd5498456-1c0a-427d-abb3-3f2520175b59', '6ff0709e-05ba-47fa-a7b3-02772669f489'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:44:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-b0515fe9-8dc5-421e-8a07-02af4df1f51f tempest-CreateVolumesFromImageTest-948938234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:44:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-b0515fe9-8dc5-421e-8a07-02af4df1f51f tempest-CreateVolumesFromImageTest-948938234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:44:41 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-b0515fe9-8dc5-421e-8a07-02af4df1f51f tempest-CreateVolumesFromImageTest-948938234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:44:41 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-b0515fe9-8dc5-421e-8a07-02af4df1f51f tempest-CreateVolumesFromImageTest-948938234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:44:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-b0515fe9-8dc5-421e-8a07-02af4df1f51f tempest-CreateVolumesFromImageTest-948938234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:44:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b0515fe9-8dc5-421e-8a07-02af4df1f51f tempest-CreateVolumesFromImageTest-948938234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:41 devstack sudo[104247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:44:41 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:41 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d54187be-8a85-404b-89cd-819d58050415 tempest-CreateVolumesFromImageTest-948938234 None] Acquiring lock "cinder-688e55f9-9ef6-4b30-bf8a-0fa1c5005e4f-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:44:41 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d54187be-8a85-404b-89cd-819d58050415 tempest-CreateVolumesFromImageTest-948938234 None] Lock "cinder-688e55f9-9ef6-4b30-bf8a-0fa1c5005e4f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:44:41 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d54187be-8a85-404b-89cd-819d58050415 tempest-CreateVolumesFromImageTest-948938234 None] Acquiring lock "cinder-quobyte-688e55f9-9ef6-4b30-bf8a-0fa1c5005e4f" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:44:41 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d54187be-8a85-404b-89cd-819d58050415 tempest-CreateVolumesFromImageTest-948938234 None] Lock "cinder-quobyte-688e55f9-9ef6-4b30-bf8a-0fa1c5005e4f" acquired by "delete_volume" :: waited 0.025s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:44:41 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b4afd0-4145-4f9d-b2a7-b294c9878f90]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:44:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d54187be-8a85-404b-89cd-819d58050415 tempest-CreateVolumesFromImageTest-948938234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-688e55f9-9ef6-4b30-bf8a-0fa1c5005e4f {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:42 devstack sudo[104249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-688e55f9-9ef6-4b30-bf8a-0fa1c5005e4f Jun 04 06:44:42 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:42 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b0515fe9-8dc5-421e-8a07-02af4df1f51f tempest-CreateVolumesFromImageTest-948938234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.637s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:42 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-b0515fe9-8dc5-421e-8a07-02af4df1f51f tempest-CreateVolumesFromImageTest-948938234 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:44:42 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-b0515fe9-8dc5-421e-8a07-02af4df1f51f tempest-CreateVolumesFromImageTest-948938234 None] Deleted volume successfully. Jun 04 06:44:42 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-b0515fe9-8dc5-421e-8a07-02af4df1f51f tempest-CreateVolumesFromImageTest-948938234 None] Lock "cinder-d0ec2340-841d-4a7e-9ca9-bf27b829e98b-delete_volume" released by "delete_volume" :: held 2.580s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:44:42 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d54187be-8a85-404b-89cd-819d58050415 tempest-CreateVolumesFromImageTest-948938234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-688e55f9-9ef6-4b30-bf8a-0fa1c5005e4f" returned: 0 in 0.775s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d54187be-8a85-404b-89cd-819d58050415 tempest-CreateVolumesFromImageTest-948938234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-688e55f9-9ef6-4b30-bf8a-0fa1c5005e4f {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:42 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-688e55f9-9ef6-4b30-bf8a-0fa1c5005e4f Jun 04 06:44:42 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:43 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d54187be-8a85-404b-89cd-819d58050415 tempest-CreateVolumesFromImageTest-948938234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-688e55f9-9ef6-4b30-bf8a-0fa1c5005e4f" returned: 0 in 0.683s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:43 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d54187be-8a85-404b-89cd-819d58050415 tempest-CreateVolumesFromImageTest-948938234 None] Lock "cinder-quobyte-688e55f9-9ef6-4b30-bf8a-0fa1c5005e4f" released by "delete_volume" :: held 1.514s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:44:43 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-d54187be-8a85-404b-89cd-819d58050415 tempest-CreateVolumesFromImageTest-948938234 None] Created reservations ['030a2b4c-efa6-4521-a534-d3d0e968d07f', '59f88f74-07c1-4573-8723-9d3a445e7b5d', '337d8dd7-5287-4e81-8890-ba09528efddc', 'ec294718-2ee6-4f09-95af-2a609fc718b5'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:44:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d54187be-8a85-404b-89cd-819d58050415 tempest-CreateVolumesFromImageTest-948938234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:44:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d54187be-8a85-404b-89cd-819d58050415 tempest-CreateVolumesFromImageTest-948938234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:44:43 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d54187be-8a85-404b-89cd-819d58050415 tempest-CreateVolumesFromImageTest-948938234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:44:43 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d54187be-8a85-404b-89cd-819d58050415 tempest-CreateVolumesFromImageTest-948938234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:44:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d54187be-8a85-404b-89cd-819d58050415 tempest-CreateVolumesFromImageTest-948938234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:44:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d54187be-8a85-404b-89cd-819d58050415 tempest-CreateVolumesFromImageTest-948938234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:43 devstack sudo[104261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:44:43 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:44 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d54187be-8a85-404b-89cd-819d58050415 tempest-CreateVolumesFromImageTest-948938234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.638s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:44 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-d54187be-8a85-404b-89cd-819d58050415 tempest-CreateVolumesFromImageTest-948938234 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:44:44 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-d54187be-8a85-404b-89cd-819d58050415 tempest-CreateVolumesFromImageTest-948938234 None] Deleted volume successfully. Jun 04 06:44:44 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d54187be-8a85-404b-89cd-819d58050415 tempest-CreateVolumesFromImageTest-948938234 None] Lock "cinder-688e55f9-9ef6-4b30-bf8a-0fa1c5005e4f-delete_volume" released by "delete_volume" :: held 2.382s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:44:46 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:44:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Flow 'volume_create_manager' (85adc6ea-bfc1-431a-b2c4-a05626cdeac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:44:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e72f23b-9917-44d4-be8f-da67e38238e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e72f23b-9917-44d4-be8f-da67e38238e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1999862413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=011d4af4-664d-496d-9109-55d1d5c8937f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21bf9fdec8ee43a19a61f1daa45b371a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:44:47Z,use_quota=True,user_id='175c9e9ac9c442df921cdfb9badb0064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e134145-3ae6-4f2c-be5c-5fa10ae88a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e134145-3ae6-4f2c-be5c-5fa10ae88a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc0669e0-f371-4022-a85d-0fd9e353d671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc0669e0-f371-4022-a85d-0fd9e353d671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '011d4af4-664d-496d-9109-55d1d5c8937f', 'volume_name': 'volume-011d4af4-664d-496d-9109-55d1d5c8937f', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b151830-f220-4927-b843-b12fb8134e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b151830-f220-4927-b843-b12fb8134e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecc9ff69-db64-4f78-a744-b6a6dbce9916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:46 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Volume 011d4af4-664d-496d-9109-55d1d5c8937f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-011d4af4-664d-496d-9109-55d1d5c8937f', 'volume_size': 1} Jun 04 06:44:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:44:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:44:46 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1999862413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=011d4af4-664d-496d-9109-55d1d5c8937f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21bf9fdec8ee43a19a61f1daa45b371a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:44:47Z,use_quota=True,user_id='175c9e9ac9c442df921cdfb9badb0064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:44:46 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Creating volume 011d4af4-664d-496d-9109-55d1d5c8937f {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:44:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:44:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:44:46 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:44:46 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:44:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:44:46 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:44:46 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:44:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-011d4af4-664d-496d-9109-55d1d5c8937f 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:46 devstack sudo[104264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-011d4af4-664d-496d-9109-55d1d5c8937f 1073741824 Jun 04 06:44:46 devstack sudo[104264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:47 devstack sudo[104264]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-011d4af4-664d-496d-9109-55d1d5c8937f 1073741824" returned: 0 in 0.732s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-011d4af4-664d-496d-9109-55d1d5c8937f {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:47 devstack sudo[104270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-011d4af4-664d-496d-9109-55d1d5c8937f Jun 04 06:44:47 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:48 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-011d4af4-664d-496d-9109-55d1d5c8937f" returned: 0 in 0.599s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:48 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:44:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:44:48 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecc9ff69-db64-4f78-a744-b6a6dbce9916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-011d4af4-664d-496d-9109-55d1d5c8937f', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:48 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ab64dce-dbac-429e-a535-8ae6f6353305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:48 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Volume volume-011d4af4-664d-496d-9109-55d1d5c8937f (011d4af4-664d-496d-9109-55d1d5c8937f): created successfully Jun 04 06:44:48 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ab64dce-dbac-429e-a535-8ae6f6353305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:48 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Flow 'volume_create_manager' (85adc6ea-bfc1-431a-b2c4-a05626cdeac7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:44:48 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-d597811d-b44d-4901-98dd-0956e618246b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Created volume successfully. Jun 04 06:44:49 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:44:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Flow 'volume_create_manager' (f3536e20-752b-443b-8c4b-85ac4e72d51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:44:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc9a076-72d3-47dd-93d0-bbc1dd94400f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc9a076-72d3-47dd-93d0-bbc1dd94400f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:44:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1564132027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=635f71b3-6ec3-4ebc-8936-184d2d09f58d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21bf9fdec8ee43a19a61f1daa45b371a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:44:50Z,use_quota=True,user_id='175c9e9ac9c442df921cdfb9badb0064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8d6ead1-35c0-46dd-9d87-ce4b7cfd163d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8d6ead1-35c0-46dd-9d87-ce4b7cfd163d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a741da25-b73d-483d-8756-cb388fb28024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a741da25-b73d-483d-8756-cb388fb28024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '635f71b3-6ec3-4ebc-8936-184d2d09f58d', 'volume_name': 'volume-635f71b3-6ec3-4ebc-8936-184d2d09f58d', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b027044b-8453-455f-a9a1-82100b48fcbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b027044b-8453-455f-a9a1-82100b48fcbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4281e707-0b70-4612-b486-cb690b28033d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:49 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Volume 635f71b3-6ec3-4ebc-8936-184d2d09f58d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-635f71b3-6ec3-4ebc-8936-184d2d09f58d', 'volume_size': 1} Jun 04 06:44:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:44:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:44:49 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:44:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1564132027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=635f71b3-6ec3-4ebc-8936-184d2d09f58d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21bf9fdec8ee43a19a61f1daa45b371a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:44:50Z,use_quota=True,user_id='175c9e9ac9c442df921cdfb9badb0064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:44:49 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Creating volume 635f71b3-6ec3-4ebc-8936-184d2d09f58d {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:44:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:44:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:44:49 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:44:49 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:44:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:44:49 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:44:49 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:44:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-635f71b3-6ec3-4ebc-8936-184d2d09f58d 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:49 devstack sudo[104273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-635f71b3-6ec3-4ebc-8936-184d2d09f58d 1073741824 Jun 04 06:44:49 devstack sudo[104273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:49 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:44:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Flow 'volume_create_manager' (37bf3dea-d446-4fd5-b7a5-4fb8d312145f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:44:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (170b2313-6283-4901-9198-f4998989cd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (170b2313-6283-4901-9198-f4998989cd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1378081564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e8aa375-e381-473e-8df4-69e13df7949b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21bf9fdec8ee43a19a61f1daa45b371a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:44:50Z,use_quota=True,user_id='175c9e9ac9c442df921cdfb9badb0064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c89afd8-42df-42cc-a709-12db5e4659c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c89afd8-42df-42cc-a709-12db5e4659c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f163f6bd-e2a7-4185-8b81-61f7089fd651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f163f6bd-e2a7-4185-8b81-61f7089fd651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e8aa375-e381-473e-8df4-69e13df7949b', 'volume_name': 'volume-0e8aa375-e381-473e-8df4-69e13df7949b', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c748c47f-cf7d-42a9-88e2-392ad7d8756a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c748c47f-cf7d-42a9-88e2-392ad7d8756a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cbe5a9d-0e93-4b25-8302-7f3b94b23bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:50 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Volume 0e8aa375-e381-473e-8df4-69e13df7949b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e8aa375-e381-473e-8df4-69e13df7949b', 'volume_size': 1} Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Flow 'volume_create_manager' (4ba76953-1d0a-48b8-a4ad-bf1722fb084f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19d46b03-1e37-4d3c-bcfe-ae292b01635b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19d46b03-1e37-4d3c-bcfe-ae292b01635b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1867876359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3fb89b8-3c6b-4529-9ac8-4918754b66ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21bf9fdec8ee43a19a61f1daa45b371a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:44:50Z,use_quota=True,user_id='175c9e9ac9c442df921cdfb9badb0064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db61eaee-2eb9-4bbe-baa9-4c9397576303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db61eaee-2eb9-4bbe-baa9-4c9397576303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee454a05-a13d-42ae-9b76-14482fa8c536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee454a05-a13d-42ae-9b76-14482fa8c536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3fb89b8-3c6b-4529-9ac8-4918754b66ab', 'volume_name': 'volume-c3fb89b8-3c6b-4529-9ac8-4918754b66ab', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e04a3518-92ce-4872-84c3-122d19698656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e04a3518-92ce-4872-84c3-122d19698656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (972ade12-3829-484b-9d41-124cef78b7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:50 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Volume c3fb89b8-3c6b-4529-9ac8-4918754b66ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3fb89b8-3c6b-4529-9ac8-4918754b66ab', 'volume_size': 1} Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:44:50 devstack sudo[104273]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-635f71b3-6ec3-4ebc-8936-184d2d09f58d 1073741824" returned: 0 in 0.893s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-635f71b3-6ec3-4ebc-8936-184d2d09f58d {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:50 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-635f71b3-6ec3-4ebc-8936-184d2d09f58d Jun 04 06:44:50 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Flow 'volume_create_manager' (117fb501-2260-451e-b14e-7f6ff4a6f788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67fe6fd3-a5e7-442c-8208-3cafceb3d290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67fe6fd3-a5e7-442c-8208-3cafceb3d290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1043961888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cde612d5-86d7-4d69-a995-d9e18ef83a1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21bf9fdec8ee43a19a61f1daa45b371a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:44:51Z,use_quota=True,user_id='175c9e9ac9c442df921cdfb9badb0064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aac7e4c6-20cd-4b97-878f-bc6a24a4cd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aac7e4c6-20cd-4b97-878f-bc6a24a4cd4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75e6cf7d-0758-430e-a84d-df9b3c511736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75e6cf7d-0758-430e-a84d-df9b3c511736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cde612d5-86d7-4d69-a995-d9e18ef83a1d', 'volume_name': 'volume-cde612d5-86d7-4d69-a995-d9e18ef83a1d', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db406d7b-4c98-46fe-8622-e6d57f106bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db406d7b-4c98-46fe-8622-e6d57f106bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b68a2835-1a2e-4310-a4ef-1944a688c121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:50 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Volume cde612d5-86d7-4d69-a995-d9e18ef83a1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cde612d5-86d7-4d69-a995-d9e18ef83a1d', 'volume_size': 1} Jun 04 06:44:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:44:51 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:44:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Flow 'volume_create_manager' (17fad4fc-ad57-4f01-845d-a524745c131b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:44:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fcf07a4-6b80-4298-8682-0fadc076b389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fcf07a4-6b80-4298-8682-0fadc076b389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1243122169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=837aadd5-0ed3-41c7-8beb-29741adfcc46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21bf9fdec8ee43a19a61f1daa45b371a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:44:51Z,use_quota=True,user_id='175c9e9ac9c442df921cdfb9badb0064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7573d4a-5955-4183-b503-d30c293e368b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7573d4a-5955-4183-b503-d30c293e368b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e97c9a02-4ece-4cf4-ae87-144928fa60f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e97c9a02-4ece-4cf4-ae87-144928fa60f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '837aadd5-0ed3-41c7-8beb-29741adfcc46', 'volume_name': 'volume-837aadd5-0ed3-41c7-8beb-29741adfcc46', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (235753b2-86ed-4996-b2f3-8eba96d17159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (235753b2-86ed-4996-b2f3-8eba96d17159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35aafa4a-fc0e-4aa8-bcbd-204af55f1af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:51 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Volume 837aadd5-0ed3-41c7-8beb-29741adfcc46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-837aadd5-0ed3-41c7-8beb-29741adfcc46', 'volume_size': 1} Jun 04 06:44:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:44:51 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-635f71b3-6ec3-4ebc-8936-184d2d09f58d" returned: 0 in 0.680s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:51 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:44:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:44:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.212s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:44:51 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1378081564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e8aa375-e381-473e-8df4-69e13df7949b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21bf9fdec8ee43a19a61f1daa45b371a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:44:50Z,use_quota=True,user_id='175c9e9ac9c442df921cdfb9badb0064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:44:51 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Creating volume 0e8aa375-e381-473e-8df4-69e13df7949b {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:44:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:44:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:44:51 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:44:51 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:44:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:44:51 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:44:51 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:44:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0e8aa375-e381-473e-8df4-69e13df7949b 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4281e707-0b70-4612-b486-cb690b28033d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-635f71b3-6ec3-4ebc-8936-184d2d09f58d', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a76f1b52-fd56-4ddd-b265-b154002d2207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:51 devstack sudo[104282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0e8aa375-e381-473e-8df4-69e13df7949b 1073741824 Jun 04 06:44:51 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:51 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Volume volume-635f71b3-6ec3-4ebc-8936-184d2d09f58d (635f71b3-6ec3-4ebc-8936-184d2d09f58d): created successfully Jun 04 06:44:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a76f1b52-fd56-4ddd-b265-b154002d2207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:51 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Flow 'volume_create_manager' (f3536e20-752b-443b-8c4b-85ac4e72d51c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:44:51 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-0cab74a8-8aa0-4a5c-9c19-003495557f6c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Created volume successfully. Jun 04 06:44:52 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0e8aa375-e381-473e-8df4-69e13df7949b 1073741824" returned: 0 in 0.829s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0e8aa375-e381-473e-8df4-69e13df7949b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:52 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0e8aa375-e381-473e-8df4-69e13df7949b Jun 04 06:44:52 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:52 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0e8aa375-e381-473e-8df4-69e13df7949b" returned: 0 in 0.625s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:52 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:44:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:44:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.266s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:44:52 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1867876359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3fb89b8-3c6b-4529-9ac8-4918754b66ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21bf9fdec8ee43a19a61f1daa45b371a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:44:50Z,use_quota=True,user_id='175c9e9ac9c442df921cdfb9badb0064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:44:52 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Creating volume c3fb89b8-3c6b-4529-9ac8-4918754b66ab {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:44:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:44:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:44:52 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:44:52 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:44:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:44:52 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:44:52 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:44:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c3fb89b8-3c6b-4529-9ac8-4918754b66ab 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:52 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cbe5a9d-0e93-4b25-8302-7f3b94b23bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e8aa375-e381-473e-8df4-69e13df7949b', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:52 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c3fb89b8-3c6b-4529-9ac8-4918754b66ab 1073741824 Jun 04 06:44:52 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69b88f68-549c-4be7-ab40-47242cae269f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:52 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:52 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Volume volume-0e8aa375-e381-473e-8df4-69e13df7949b (0e8aa375-e381-473e-8df4-69e13df7949b): created successfully Jun 04 06:44:52 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69b88f68-549c-4be7-ab40-47242cae269f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:52 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Flow 'volume_create_manager' (37bf3dea-d446-4fd5-b7a5-4fb8d312145f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:44:52 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-65a2d034-c6cc-44bb-a611-b871b9f7bf7b tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Created volume successfully. Jun 04 06:44:53 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c3fb89b8-3c6b-4529-9ac8-4918754b66ab 1073741824" returned: 0 in 0.801s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c3fb89b8-3c6b-4529-9ac8-4918754b66ab {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:53 devstack sudo[104320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c3fb89b8-3c6b-4529-9ac8-4918754b66ab Jun 04 06:44:53 devstack sudo[104320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:54 devstack sudo[104320]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c3fb89b8-3c6b-4529-9ac8-4918754b66ab" returned: 0 in 0.664s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:54 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:44:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:44:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.474s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:44:54 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1043961888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cde612d5-86d7-4d69-a995-d9e18ef83a1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21bf9fdec8ee43a19a61f1daa45b371a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:44:51Z,use_quota=True,user_id='175c9e9ac9c442df921cdfb9badb0064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:44:54 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Creating volume cde612d5-86d7-4d69-a995-d9e18ef83a1d {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:44:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:44:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:44:54 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:44:54 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:44:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:44:54 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:44:54 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:44:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cde612d5-86d7-4d69-a995-d9e18ef83a1d 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (972ade12-3829-484b-9d41-124cef78b7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3fb89b8-3c6b-4529-9ac8-4918754b66ab', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:54 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cde612d5-86d7-4d69-a995-d9e18ef83a1d 1073741824 Jun 04 06:44:54 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8300d9b8-01ce-47fd-8221-c1dffe5987e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:54 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Volume volume-c3fb89b8-3c6b-4529-9ac8-4918754b66ab (c3fb89b8-3c6b-4529-9ac8-4918754b66ab): created successfully Jun 04 06:44:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8300d9b8-01ce-47fd-8221-c1dffe5987e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Flow 'volume_create_manager' (4ba76953-1d0a-48b8-a4ad-bf1722fb084f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:44:54 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-c22e8dab-c4b2-426a-9461-e19ebadc9950 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Created volume successfully. Jun 04 06:44:55 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cde612d5-86d7-4d69-a995-d9e18ef83a1d 1073741824" returned: 0 in 0.759s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cde612d5-86d7-4d69-a995-d9e18ef83a1d {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:55 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cde612d5-86d7-4d69-a995-d9e18ef83a1d Jun 04 06:44:55 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:55 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cde612d5-86d7-4d69-a995-d9e18ef83a1d" returned: 0 in 0.774s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:44:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:44:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.682s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:44:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1243122169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=837aadd5-0ed3-41c7-8beb-29741adfcc46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21bf9fdec8ee43a19a61f1daa45b371a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:44:51Z,use_quota=True,user_id='175c9e9ac9c442df921cdfb9badb0064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:44:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Creating volume 837aadd5-0ed3-41c7-8beb-29741adfcc46 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:44:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:44:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:44:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:44:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:44:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:44:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:44:55 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:44:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-837aadd5-0ed3-41c7-8beb-29741adfcc46 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b68a2835-1a2e-4310-a4ef-1944a688c121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cde612d5-86d7-4d69-a995-d9e18ef83a1d', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed5acdc-8ba5-4906-a4f5-d45ca332d3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:55 devstack sudo[104371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-837aadd5-0ed3-41c7-8beb-29741adfcc46 1073741824 Jun 04 06:44:55 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:56 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Volume volume-cde612d5-86d7-4d69-a995-d9e18ef83a1d (cde612d5-86d7-4d69-a995-d9e18ef83a1d): created successfully Jun 04 06:44:56 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed5acdc-8ba5-4906-a4f5-d45ca332d3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:56 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Flow 'volume_create_manager' (117fb501-2260-451e-b14e-7f6ff4a6f788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:44:56 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-15169205-373b-407a-b966-de5066a8f946 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Created volume successfully. Jun 04 06:44:57 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-837aadd5-0ed3-41c7-8beb-29741adfcc46 1073741824" returned: 0 in 1.271s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-837aadd5-0ed3-41c7-8beb-29741adfcc46 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:57 devstack sudo[104455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-837aadd5-0ed3-41c7-8beb-29741adfcc46 Jun 04 06:44:57 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:57 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-837aadd5-0ed3-41c7-8beb-29741adfcc46" returned: 0 in 0.701s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:57 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] <== create_volume: return (2067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:44:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.077s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:44:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35aafa4a-fc0e-4aa8-bcbd-204af55f1af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-837aadd5-0ed3-41c7-8beb-29741adfcc46', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:57 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d482049-45e0-414f-b64a-3083bc555e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:44:57 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Volume volume-837aadd5-0ed3-41c7-8beb-29741adfcc46 (837aadd5-0ed3-41c7-8beb-29741adfcc46): created successfully Jun 04 06:44:58 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d482049-45e0-414f-b64a-3083bc555e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:44:58 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Flow 'volume_create_manager' (17fad4fc-ad57-4f01-845d-a524745c131b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:44:58 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-86d442fc-86ed-4fbd-9696-35979d311689 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Created volume successfully. Jun 04 06:44:58 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-cf54dad2-b27f-4554-afb3-4afe9e149649 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Acquiring lock "cinder-837aadd5-0ed3-41c7-8beb-29741adfcc46-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:44:58 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-cf54dad2-b27f-4554-afb3-4afe9e149649 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "cinder-837aadd5-0ed3-41c7-8beb-29741adfcc46-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:44:59 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-cf54dad2-b27f-4554-afb3-4afe9e149649 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Acquiring lock "cinder-quobyte-837aadd5-0ed3-41c7-8beb-29741adfcc46" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:44:59 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-cf54dad2-b27f-4554-afb3-4afe9e149649 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "cinder-quobyte-837aadd5-0ed3-41c7-8beb-29741adfcc46" acquired by "delete_volume" :: waited 0.017s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:44:59 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[69427b66-aab6-49dd-ae44-bdadeecc532d]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:44:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-cf54dad2-b27f-4554-afb3-4afe9e149649 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-837aadd5-0ed3-41c7-8beb-29741adfcc46 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:59 devstack sudo[104466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-837aadd5-0ed3-41c7-8beb-29741adfcc46 Jun 04 06:44:59 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:44:59 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root Jun 04 06:44:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-cf54dad2-b27f-4554-afb3-4afe9e149649 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-837aadd5-0ed3-41c7-8beb-29741adfcc46" returned: 0 in 0.811s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:44:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-cf54dad2-b27f-4554-afb3-4afe9e149649 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-837aadd5-0ed3-41c7-8beb-29741adfcc46 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:44:59 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-837aadd5-0ed3-41c7-8beb-29741adfcc46 Jun 04 06:44:59 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:00 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-cf54dad2-b27f-4554-afb3-4afe9e149649 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-837aadd5-0ed3-41c7-8beb-29741adfcc46" returned: 0 in 0.622s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:00 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-cf54dad2-b27f-4554-afb3-4afe9e149649 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "cinder-quobyte-837aadd5-0ed3-41c7-8beb-29741adfcc46" released by "delete_volume" :: held 1.476s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:45:00 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-cf54dad2-b27f-4554-afb3-4afe9e149649 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Created reservations ['1b002237-4b16-43c5-8e72-0e94e3271bae', '9860a61a-e85b-4bcc-a235-af227d1635a8', 'b1ffdda5-b97f-4ee1-9e95-4c269a5c1eaf', '3ba97050-2430-42fd-916d-7f5dc2ba2f74'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:45:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-cf54dad2-b27f-4554-afb3-4afe9e149649 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:45:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-cf54dad2-b27f-4554-afb3-4afe9e149649 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:45:00 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-cf54dad2-b27f-4554-afb3-4afe9e149649 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:45:00 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-cf54dad2-b27f-4554-afb3-4afe9e149649 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:45:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-cf54dad2-b27f-4554-afb3-4afe9e149649 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:45:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-cf54dad2-b27f-4554-afb3-4afe9e149649 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:00 devstack sudo[104474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:45:00 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:01 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:01 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-57f6f567-b19d-4863-8081-645300dbd11f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Acquiring lock "cinder-cde612d5-86d7-4d69-a995-d9e18ef83a1d-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:45:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-cf54dad2-b27f-4554-afb3-4afe9e149649 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.630s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:01 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-cf54dad2-b27f-4554-afb3-4afe9e149649 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:45:01 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-cf54dad2-b27f-4554-afb3-4afe9e149649 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Deleted volume successfully. Jun 04 06:45:01 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-57f6f567-b19d-4863-8081-645300dbd11f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "cinder-cde612d5-86d7-4d69-a995-d9e18ef83a1d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:45:01 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-cf54dad2-b27f-4554-afb3-4afe9e149649 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "cinder-837aadd5-0ed3-41c7-8beb-29741adfcc46-delete_volume" released by "delete_volume" :: held 2.323s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:45:01 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-57f6f567-b19d-4863-8081-645300dbd11f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Acquiring lock "cinder-quobyte-cde612d5-86d7-4d69-a995-d9e18ef83a1d" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:45:01 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-57f6f567-b19d-4863-8081-645300dbd11f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "cinder-quobyte-cde612d5-86d7-4d69-a995-d9e18ef83a1d" acquired by "delete_volume" :: waited 0.017s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:45:01 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b52eed-a237-46c6-a864-08653ff4d9ba]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:45:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-57f6f567-b19d-4863-8081-645300dbd11f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cde612d5-86d7-4d69-a995-d9e18ef83a1d {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:01 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cde612d5-86d7-4d69-a995-d9e18ef83a1d Jun 04 06:45:01 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:02 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-57f6f567-b19d-4863-8081-645300dbd11f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cde612d5-86d7-4d69-a995-d9e18ef83a1d" returned: 0 in 0.713s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-57f6f567-b19d-4863-8081-645300dbd11f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cde612d5-86d7-4d69-a995-d9e18ef83a1d {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:02 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cde612d5-86d7-4d69-a995-d9e18ef83a1d Jun 04 06:45:02 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:02 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-57f6f567-b19d-4863-8081-645300dbd11f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cde612d5-86d7-4d69-a995-d9e18ef83a1d" returned: 0 in 0.605s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:02 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-57f6f567-b19d-4863-8081-645300dbd11f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "cinder-quobyte-cde612d5-86d7-4d69-a995-d9e18ef83a1d" released by "delete_volume" :: held 1.361s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:45:02 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-57f6f567-b19d-4863-8081-645300dbd11f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Created reservations ['a6190cdf-dbf9-4b16-9cce-59d2a5606254', '3e5a7def-417e-4a91-905f-38f34c1efc37', '61d453e8-d79c-4439-9734-a339c6d7897e', 'd3b0bed9-a3e0-417e-ab28-21775c3b83e5'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:45:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-57f6f567-b19d-4863-8081-645300dbd11f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:45:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-57f6f567-b19d-4863-8081-645300dbd11f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:45:02 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-57f6f567-b19d-4863-8081-645300dbd11f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:45:02 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-57f6f567-b19d-4863-8081-645300dbd11f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:45:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-57f6f567-b19d-4863-8081-645300dbd11f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:45:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-57f6f567-b19d-4863-8081-645300dbd11f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:02 devstack sudo[104488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:45:02 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:03 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-57f6f567-b19d-4863-8081-645300dbd11f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.579s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:03 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-57f6f567-b19d-4863-8081-645300dbd11f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:45:03 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-57f6f567-b19d-4863-8081-645300dbd11f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Deleted volume successfully. Jun 04 06:45:03 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-57f6f567-b19d-4863-8081-645300dbd11f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "cinder-cde612d5-86d7-4d69-a995-d9e18ef83a1d-delete_volume" released by "delete_volume" :: held 2.146s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:45:03 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0c50163d-95df-4440-a37f-715fc4656242 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Acquiring lock "cinder-c3fb89b8-3c6b-4529-9ac8-4918754b66ab-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:45:03 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0c50163d-95df-4440-a37f-715fc4656242 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "cinder-c3fb89b8-3c6b-4529-9ac8-4918754b66ab-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:45:03 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0c50163d-95df-4440-a37f-715fc4656242 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Acquiring lock "cinder-quobyte-c3fb89b8-3c6b-4529-9ac8-4918754b66ab" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:45:03 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0c50163d-95df-4440-a37f-715fc4656242 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "cinder-quobyte-c3fb89b8-3c6b-4529-9ac8-4918754b66ab" acquired by "delete_volume" :: waited 0.023s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:45:03 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e6195d-dc8a-4e3b-be97-1d5aaef0d15a]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:45:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0c50163d-95df-4440-a37f-715fc4656242 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c3fb89b8-3c6b-4529-9ac8-4918754b66ab {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:03 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c3fb89b8-3c6b-4529-9ac8-4918754b66ab Jun 04 06:45:03 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:04 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0c50163d-95df-4440-a37f-715fc4656242 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c3fb89b8-3c6b-4529-9ac8-4918754b66ab" returned: 0 in 0.695s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0c50163d-95df-4440-a37f-715fc4656242 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c3fb89b8-3c6b-4529-9ac8-4918754b66ab {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:04 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c3fb89b8-3c6b-4529-9ac8-4918754b66ab Jun 04 06:45:04 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:04 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0c50163d-95df-4440-a37f-715fc4656242 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c3fb89b8-3c6b-4529-9ac8-4918754b66ab" returned: 0 in 0.611s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:04 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0c50163d-95df-4440-a37f-715fc4656242 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "cinder-quobyte-c3fb89b8-3c6b-4529-9ac8-4918754b66ab" released by "delete_volume" :: held 1.345s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:45:04 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-0c50163d-95df-4440-a37f-715fc4656242 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Created reservations ['7f44071e-d6e3-4854-a043-1db5474b6127', 'f95fd43d-947a-4a11-826f-f7689a29e4ac', '0d08b805-2908-4930-ad2d-ca384603a8bc', '34b7d085-b747-4bc8-8b1e-b34ce1762f41'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:45:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0c50163d-95df-4440-a37f-715fc4656242 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:45:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0c50163d-95df-4440-a37f-715fc4656242 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:45:05 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0c50163d-95df-4440-a37f-715fc4656242 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:45:05 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-0c50163d-95df-4440-a37f-715fc4656242 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:45:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0c50163d-95df-4440-a37f-715fc4656242 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:45:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0c50163d-95df-4440-a37f-715fc4656242 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:05 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:45:05 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:05 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0c50163d-95df-4440-a37f-715fc4656242 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.572s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:05 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-0c50163d-95df-4440-a37f-715fc4656242 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:45:05 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-0c50163d-95df-4440-a37f-715fc4656242 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Deleted volume successfully. Jun 04 06:45:05 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-0c50163d-95df-4440-a37f-715fc4656242 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "cinder-c3fb89b8-3c6b-4529-9ac8-4918754b66ab-delete_volume" released by "delete_volume" :: held 2.118s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:45:05 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-742cbf94-91c1-494f-afd5-67bc29ff762c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Acquiring lock "cinder-0e8aa375-e381-473e-8df4-69e13df7949b-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:45:05 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-742cbf94-91c1-494f-afd5-67bc29ff762c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "cinder-0e8aa375-e381-473e-8df4-69e13df7949b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:45:05 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-742cbf94-91c1-494f-afd5-67bc29ff762c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Acquiring lock "cinder-quobyte-0e8aa375-e381-473e-8df4-69e13df7949b" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:45:05 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-742cbf94-91c1-494f-afd5-67bc29ff762c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "cinder-quobyte-0e8aa375-e381-473e-8df4-69e13df7949b" acquired by "delete_volume" :: waited 0.021s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:45:05 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[759e6428-301a-4c68-8c76-d3440081cf2f]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:45:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-742cbf94-91c1-494f-afd5-67bc29ff762c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0e8aa375-e381-473e-8df4-69e13df7949b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:05 devstack sudo[104502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0e8aa375-e381-473e-8df4-69e13df7949b Jun 04 06:45:05 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:06 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-742cbf94-91c1-494f-afd5-67bc29ff762c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0e8aa375-e381-473e-8df4-69e13df7949b" returned: 0 in 0.715s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-742cbf94-91c1-494f-afd5-67bc29ff762c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0e8aa375-e381-473e-8df4-69e13df7949b {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:06 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0e8aa375-e381-473e-8df4-69e13df7949b Jun 04 06:45:06 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:07 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-742cbf94-91c1-494f-afd5-67bc29ff762c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0e8aa375-e381-473e-8df4-69e13df7949b" returned: 0 in 0.576s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:07 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-742cbf94-91c1-494f-afd5-67bc29ff762c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "cinder-quobyte-0e8aa375-e381-473e-8df4-69e13df7949b" released by "delete_volume" :: held 1.337s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:45:07 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-742cbf94-91c1-494f-afd5-67bc29ff762c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Created reservations ['d528ba1e-4f9c-4890-b1e0-13f44c28e15b', '1ab82c92-529b-47dc-90e6-d4aeecda5017', 'c0b1c22e-4cfe-4b0d-a967-002a20791877', '9b56f9e1-d63d-4435-9604-8a86660c3993'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:45:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-742cbf94-91c1-494f-afd5-67bc29ff762c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:45:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-742cbf94-91c1-494f-afd5-67bc29ff762c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:45:07 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-742cbf94-91c1-494f-afd5-67bc29ff762c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:45:07 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-742cbf94-91c1-494f-afd5-67bc29ff762c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:45:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-742cbf94-91c1-494f-afd5-67bc29ff762c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:45:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-742cbf94-91c1-494f-afd5-67bc29ff762c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:07 devstack sudo[104511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:45:07 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:07 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-742cbf94-91c1-494f-afd5-67bc29ff762c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.599s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:07 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-742cbf94-91c1-494f-afd5-67bc29ff762c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:45:07 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-742cbf94-91c1-494f-afd5-67bc29ff762c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Deleted volume successfully. Jun 04 06:45:07 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-742cbf94-91c1-494f-afd5-67bc29ff762c tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "cinder-0e8aa375-e381-473e-8df4-69e13df7949b-delete_volume" released by "delete_volume" :: held 2.183s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:45:07 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-70ded93b-b5da-46e1-bd86-8bae168fe39f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Acquiring lock "cinder-635f71b3-6ec3-4ebc-8936-184d2d09f58d-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:45:08 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-70ded93b-b5da-46e1-bd86-8bae168fe39f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "cinder-635f71b3-6ec3-4ebc-8936-184d2d09f58d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:45:08 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-70ded93b-b5da-46e1-bd86-8bae168fe39f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Acquiring lock "cinder-quobyte-635f71b3-6ec3-4ebc-8936-184d2d09f58d" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:45:08 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-70ded93b-b5da-46e1-bd86-8bae168fe39f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "cinder-quobyte-635f71b3-6ec3-4ebc-8936-184d2d09f58d" acquired by "delete_volume" :: waited 0.026s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:45:08 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b41ef0-939c-4c8c-b2fb-8b29ba003bf3]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:45:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-70ded93b-b5da-46e1-bd86-8bae168fe39f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-635f71b3-6ec3-4ebc-8936-184d2d09f58d {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:08 devstack sudo[104514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-635f71b3-6ec3-4ebc-8936-184d2d09f58d Jun 04 06:45:08 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:08 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-70ded93b-b5da-46e1-bd86-8bae168fe39f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-635f71b3-6ec3-4ebc-8936-184d2d09f58d" returned: 0 in 0.697s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-70ded93b-b5da-46e1-bd86-8bae168fe39f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-635f71b3-6ec3-4ebc-8936-184d2d09f58d {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:08 devstack sudo[104519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-635f71b3-6ec3-4ebc-8936-184d2d09f58d Jun 04 06:45:08 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:09 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-70ded93b-b5da-46e1-bd86-8bae168fe39f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-635f71b3-6ec3-4ebc-8936-184d2d09f58d" returned: 0 in 0.605s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:09 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-70ded93b-b5da-46e1-bd86-8bae168fe39f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "cinder-quobyte-635f71b3-6ec3-4ebc-8936-184d2d09f58d" released by "delete_volume" :: held 1.347s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:45:09 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-70ded93b-b5da-46e1-bd86-8bae168fe39f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Created reservations ['99585603-37b4-4e71-9d66-c37bd7de39c2', 'c08a4276-699b-4f35-bb55-ccd9b1bc6ec8', '459e171d-d42e-43e6-95bf-500c1951efff', '27ceac08-fa37-4939-a2ec-3c63cc02a6e8'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:45:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-70ded93b-b5da-46e1-bd86-8bae168fe39f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:45:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-70ded93b-b5da-46e1-bd86-8bae168fe39f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:45:09 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-70ded93b-b5da-46e1-bd86-8bae168fe39f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:45:09 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-70ded93b-b5da-46e1-bd86-8bae168fe39f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:45:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-70ded93b-b5da-46e1-bd86-8bae168fe39f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:45:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-70ded93b-b5da-46e1-bd86-8bae168fe39f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:09 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:45:09 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:10 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-70ded93b-b5da-46e1-bd86-8bae168fe39f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.595s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:10 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-70ded93b-b5da-46e1-bd86-8bae168fe39f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:45:10 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-70ded93b-b5da-46e1-bd86-8bae168fe39f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Deleted volume successfully. Jun 04 06:45:10 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-70ded93b-b5da-46e1-bd86-8bae168fe39f tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "cinder-635f71b3-6ec3-4ebc-8936-184d2d09f58d-delete_volume" released by "delete_volume" :: held 2.146s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:45:10 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-41214da9-c2b9-444b-8970-d5e0c69b3781 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Acquiring lock "cinder-011d4af4-664d-496d-9109-55d1d5c8937f-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:45:10 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-41214da9-c2b9-444b-8970-d5e0c69b3781 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "cinder-011d4af4-664d-496d-9109-55d1d5c8937f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:45:10 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-41214da9-c2b9-444b-8970-d5e0c69b3781 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Acquiring lock "cinder-quobyte-011d4af4-664d-496d-9109-55d1d5c8937f" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:45:10 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-41214da9-c2b9-444b-8970-d5e0c69b3781 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "cinder-quobyte-011d4af4-664d-496d-9109-55d1d5c8937f" acquired by "delete_volume" :: waited 0.015s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:45:10 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07ec761-5b49-48a3-8d83-da2691502578]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:45:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41214da9-c2b9-444b-8970-d5e0c69b3781 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-011d4af4-664d-496d-9109-55d1d5c8937f {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:10 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-011d4af4-664d-496d-9109-55d1d5c8937f Jun 04 06:45:10 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:10 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41214da9-c2b9-444b-8970-d5e0c69b3781 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-011d4af4-664d-496d-9109-55d1d5c8937f" returned: 0 in 0.684s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41214da9-c2b9-444b-8970-d5e0c69b3781 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-011d4af4-664d-496d-9109-55d1d5c8937f {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:11 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-011d4af4-664d-496d-9109-55d1d5c8937f Jun 04 06:45:11 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:45:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:45:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:45:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:45:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:45:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:45:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:11 devstack sudo[104533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:45:11 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:11 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41214da9-c2b9-444b-8970-d5e0c69b3781 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-011d4af4-664d-496d-9109-55d1d5c8937f" returned: 0 in 0.614s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:11 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-41214da9-c2b9-444b-8970-d5e0c69b3781 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "cinder-quobyte-011d4af4-664d-496d-9109-55d1d5c8937f" released by "delete_volume" :: held 1.338s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:45:11 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-41214da9-c2b9-444b-8970-d5e0c69b3781 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Created reservations ['f7a30137-c7af-4c0b-a3fb-d9f13b7d3e67', '0f927e3a-e865-4f83-b397-a808d6869bb0', '31ea8c28-abe5-440d-8f0b-2fe6c4f2c666', '2e9ed3b4-9bbc-42de-928a-5b3b254f5bc3'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:45:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-41214da9-c2b9-444b-8970-d5e0c69b3781 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:45:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-41214da9-c2b9-444b-8970-d5e0c69b3781 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:45:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-41214da9-c2b9-444b-8970-d5e0c69b3781 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:45:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-41214da9-c2b9-444b-8970-d5e0c69b3781 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:45:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-41214da9-c2b9-444b-8970-d5e0c69b3781 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:45:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41214da9-c2b9-444b-8970-d5e0c69b3781 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:11 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.616s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:11 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:45:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager._thread_info {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:45:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread count: 28 {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 06:45:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread info: [<_MainThread(MainThread, started 131797370544256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 06:45:11 devstack sudo[104537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:45:11 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:12 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-41214da9-c2b9-444b-8970-d5e0c69b3781 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.661s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:12 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-41214da9-c2b9-444b-8970-d5e0c69b3781 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:45:12 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-41214da9-c2b9-444b-8970-d5e0c69b3781 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Deleted volume successfully. Jun 04 06:45:12 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-41214da9-c2b9-444b-8970-d5e0c69b3781 tempest-CreateVolumesFromSourceVolumeTest-1818178463 None] Lock "cinder-011d4af4-664d-496d-9109-55d1d5c8937f-delete_volume" released by "delete_volume" :: held 2.216s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:45:15 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:45:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] Flow 'volume_create_manager' (f708ec4b-9c97-4509-b7a6-290f30cdad92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:45:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2532b15-7b29-427b-932f-dc9d9eab46b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:45:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2532b15-7b29-427b-932f-dc9d9eab46b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1769873979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb514c4a-eb12-432a-8ff1-bc7811e66324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1eb01549401404cb75e3cb9e0d2c96b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:45:15Z,use_quota=True,user_id='dabe97bf3ce94c2aa57d7865e5918df2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:45:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb3dda45-8114-40e3-9dd8-f85ec48ae01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:45:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb3dda45-8114-40e3-9dd8-f85ec48ae01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:45:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (727243d9-8fda-48c6-be58-5b5104b011eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:45:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (727243d9-8fda-48c6-be58-5b5104b011eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb514c4a-eb12-432a-8ff1-bc7811e66324', 'volume_name': 'volume-fb514c4a-eb12-432a-8ff1-bc7811e66324', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:45:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bcd0d01-d5ea-4b21-8752-889819e6db0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:45:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bcd0d01-d5ea-4b21-8752-889819e6db0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:45:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ac3f201-a290-4d72-822d-bd8c4f26dcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:45:15 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] Volume fb514c4a-eb12-432a-8ff1-bc7811e66324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb514c4a-eb12-432a-8ff1-bc7811e66324', 'volume_size': 1} Jun 04 06:45:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:45:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:45:15 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1769873979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb514c4a-eb12-432a-8ff1-bc7811e66324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1eb01549401404cb75e3cb9e0d2c96b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:45:15Z,use_quota=True,user_id='dabe97bf3ce94c2aa57d7865e5918df2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:45:15 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] Creating volume fb514c4a-eb12-432a-8ff1-bc7811e66324 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:45:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:45:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:45:15 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:45:15 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:45:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:45:15 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:45:15 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:45:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:15 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324 1073741824 Jun 04 06:45:15 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:16 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324 1073741824" returned: 0 in 0.842s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:16 devstack sudo[104546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324 Jun 04 06:45:16 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:16 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324" returned: 0 in 0.639s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:16 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:45:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:45:16 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ac3f201-a290-4d72-822d-bd8c4f26dcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb514c4a-eb12-432a-8ff1-bc7811e66324', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:45:16 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8488747b-3884-47ad-8943-e804b9fdedc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:45:16 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] Volume volume-fb514c4a-eb12-432a-8ff1-bc7811e66324 (fb514c4a-eb12-432a-8ff1-bc7811e66324): created successfully Jun 04 06:45:16 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8488747b-3884-47ad-8943-e804b9fdedc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:45:16 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] Flow 'volume_create_manager' (f708ec4b-9c97-4509-b7a6-290f30cdad92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:45:16 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-7a0f1ecd-c8a9-4367-8726-6ffdafb491c8 tempest-VolumeDependencyTests-1772867454 None] Created volume successfully. Jun 04 06:45:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-4ba2b5ce-512c-4548-acc3-f5b4bf12501f tempest-VolumeDependencyTests-1772867454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:45:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-4ba2b5ce-512c-4548-acc3-f5b4bf12501f tempest-VolumeDependencyTests-1772867454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:45:17 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-4ba2b5ce-512c-4548-acc3-f5b4bf12501f tempest-VolumeDependencyTests-1772867454 None] Creating offline snapshot f8fbbbab-6785-4df4-b861-be16c39bec06 of volume fb514c4a-eb12-432a-8ff1-bc7811e66324 {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:45:17 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5cf54b-15fb-461c-a83d-6cc28de6bb3d]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:45:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4ba2b5ce-512c-4548-acc3-f5b4bf12501f tempest-VolumeDependencyTests-1772867454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:17 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324 Jun 04 06:45:17 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:18 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4ba2b5ce-512c-4548-acc3-f5b4bf12501f tempest-VolumeDependencyTests-1772867454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324" returned: 0 in 0.780s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4ba2b5ce-512c-4548-acc3-f5b4bf12501f tempest-VolumeDependencyTests-1772867454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324.f8fbbbab-6785-4df4-b861-be16c39bec06 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:18 devstack sudo[104563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324.f8fbbbab-6785-4df4-b861-be16c39bec06 1G Jun 04 06:45:18 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:19 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4ba2b5ce-512c-4548-acc3-f5b4bf12501f tempest-VolumeDependencyTests-1772867454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324.f8fbbbab-6785-4df4-b861-be16c39bec06 1G" returned: 0 in 0.786s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4ba2b5ce-512c-4548-acc3-f5b4bf12501f tempest-VolumeDependencyTests-1772867454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb514c4a-eb12-432a-8ff1-bc7811e66324 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324.f8fbbbab-6785-4df4-b861-be16c39bec06 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:19 devstack sudo[104574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb514c4a-eb12-432a-8ff1-bc7811e66324 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324.f8fbbbab-6785-4df4-b861-be16c39bec06 Jun 04 06:45:19 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:20 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4ba2b5ce-512c-4548-acc3-f5b4bf12501f tempest-VolumeDependencyTests-1772867454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb514c4a-eb12-432a-8ff1-bc7811e66324 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324.f8fbbbab-6785-4df4-b861-be16c39bec06" returned: 0 in 0.801s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:20 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-4ba2b5ce-512c-4548-acc3-f5b4bf12501f tempest-VolumeDependencyTests-1772867454 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324.f8fbbbab-6785-4df4-b861-be16c39bec06 is being set with open permissions: ugo+rw Jun 04 06:45:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4ba2b5ce-512c-4548-acc3-f5b4bf12501f tempest-VolumeDependencyTests-1772867454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324.f8fbbbab-6785-4df4-b861-be16c39bec06 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:20 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324.f8fbbbab-6785-4df4-b861-be16c39bec06 Jun 04 06:45:20 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:20 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4ba2b5ce-512c-4548-acc3-f5b4bf12501f tempest-VolumeDependencyTests-1772867454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324.f8fbbbab-6785-4df4-b861-be16c39bec06" returned: 0 in 0.660s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:20 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=88,cinder:UPDATE=128,cinder:INSERT=29,cinder:DELETE=7 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:45:20 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=89,cinder:UPDATE=130,cinder:DELETE=17,cinder:INSERT=28 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:45:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4ba2b5ce-512c-4548-acc3-f5b4bf12501f tempest-VolumeDependencyTests-1772867454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:20 devstack sudo[104584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324.info Jun 04 06:45:20 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:21 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4ba2b5ce-512c-4548-acc3-f5b4bf12501f tempest-VolumeDependencyTests-1772867454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324.info" returned: 0 in 0.709s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:21 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-4ba2b5ce-512c-4548-acc3-f5b4bf12501f tempest-VolumeDependencyTests-1772867454 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324.info is being set with open permissions: ugo+rw Jun 04 06:45:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4ba2b5ce-512c-4548-acc3-f5b4bf12501f tempest-VolumeDependencyTests-1772867454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:21 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324.info Jun 04 06:45:21 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:22 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-4ba2b5ce-512c-4548-acc3-f5b4bf12501f tempest-VolumeDependencyTests-1772867454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324.info" returned: 0 in 0.631s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-4ba2b5ce-512c-4548-acc3-f5b4bf12501f tempest-VolumeDependencyTests-1772867454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.472s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:45:22 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-4ba2b5ce-512c-4548-acc3-f5b4bf12501f tempest-VolumeDependencyTests-1772867454 None] Create snapshot completed successfully Jun 04 06:45:23 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-a233fa13-4344-432e-93ce-a0beb7169010 req-2cf25541-6f1f-439a-9558-e2b3398629cf tempest-TestMinimumBasicScenario-1577532672 None] Terminate volume connection completed successfully. Jun 04 06:45:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-a233fa13-4344-432e-93ce-a0beb7169010 req-2cf25541-6f1f-439a-9558-e2b3398629cf tempest-TestMinimumBasicScenario-1577532672 None] Deleting attachment fbd4a0e3-d782-48f1-ac54-c99999eda32b. {{(pid=86069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 06:45:23 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:45:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Flow 'volume_create_manager' (2f03147a-711b-415e-8530-b7b8015131bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:45:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f23e5409-dfc6-49aa-bde8-0dec7ec08508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:45:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f23e5409-dfc6-49aa-bde8-0dec7ec08508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1666826305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=984977bb-9984-430c-a957-0a0514d91bb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1eb01549401404cb75e3cb9e0d2c96b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f8fbbbab-6785-4df4-b861-be16c39bec06,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:45:23Z,use_quota=True,user_id='dabe97bf3ce94c2aa57d7865e5918df2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:45:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dfc94ff-a708-4276-b7de-813342692300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:45:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dfc94ff-a708-4276-b7de-813342692300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:45:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77db39a9-becf-4442-a3fe-633211e72c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:45:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77db39a9-becf-4442-a3fe-633211e72c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '984977bb-9984-430c-a957-0a0514d91bb4', 'volume_name': 'volume-984977bb-9984-430c-a957-0a0514d91bb4', 'volume_size': 1, 'snapshot_id': 'f8fbbbab-6785-4df4-b861-be16c39bec06'}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:45:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (749629e8-c52c-4eb1-80f0-40d8fdcebdf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:45:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (749629e8-c52c-4eb1-80f0-40d8fdcebdf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:45:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4f4b368-04a0-4279-8b47-f4ed90f937bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:45:23 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Volume 984977bb-9984-430c-a957-0a0514d91bb4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-984977bb-9984-430c-a957-0a0514d91bb4', 'volume_size': 1, 'snapshot_id': 'f8fbbbab-6785-4df4-b861-be16c39bec06'} Jun 04 06:45:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:45:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:45:23 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Acquiring lock "cinder-quobyte-f8fbbbab-6785-4df4-b861-be16c39bec06-984977bb-9984-430c-a957-0a0514d91bb4" by "_create_volume_from_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:45:23 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Lock "cinder-quobyte-f8fbbbab-6785-4df4-b861-be16c39bec06-984977bb-9984-430c-a957-0a0514d91bb4" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:45:23 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Creating volume 984977bb-9984-430c-a957-0a0514d91bb4 from snapshot f8fbbbab-6785-4df4-b861-be16c39bec06 {{(pid=86069) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 04 06:45:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:45:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:45:23 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:45:23 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:45:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:45:23 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:45:23 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Acquiring lock "cinder-quobyte-984977bb-9984-430c-a957-0a0514d91bb4" by "_copy_volume_from_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:45:23 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Lock "cinder-quobyte-984977bb-9984-430c-a957-0a0514d91bb4" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:45:23 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] snapshot: f8fbbbab-6785-4df4-b861-be16c39bec06, volume: 984977bb-9984-430c-a957-0a0514d91bb4, {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 06:45:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:45:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:45:23 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:45:23 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:45:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:45:23 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e39ab4-834f-48f1-b732-11a0a65a3ecd]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:45:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324.f8fbbbab-6785-4df4-b861-be16c39bec06 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:23 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324.f8fbbbab-6785-4df4-b861-be16c39bec06 Jun 04 06:45:23 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:24 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324.f8fbbbab-6785-4df4-b861-be16c39bec06" returned: 0 in 0.729s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:24 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb514c4a-eb12-432a-8ff1-bc7811e66324(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:45:24 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324 {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 06:45:24 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Creating direct copy from snapshot {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 06:45:24 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e44de25-de08-4bb6-b5d9-f9fc34d33049]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:45:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:24 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324 Jun 04 06:45:24 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:25 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324" returned: 0 in 0.736s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:25 devstack cinder-volume[86069]: DEBUG cinder.utils [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Path /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-984977bb-9984-430c-a957-0a0514d91bb4 not found in is_blk_device check {{(pid=86069) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 04 06:45:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-984977bb-9984-430c-a957-0a0514d91bb4 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:25 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-984977bb-9984-430c-a957-0a0514d91bb4 Jun 04 06:45:25 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:25 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c6cd3b93-43df-4e2e-8705-8622f58e47c3 tempest-TestMinimumBasicScenario-1577532672 None] Acquiring lock "cinder-a96b1af0-dc39-45b8-b72e-cb0489bef5ce-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:45:25 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c6cd3b93-43df-4e2e-8705-8622f58e47c3 tempest-TestMinimumBasicScenario-1577532672 None] Lock "cinder-a96b1af0-dc39-45b8-b72e-cb0489bef5ce-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:45:25 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c6cd3b93-43df-4e2e-8705-8622f58e47c3 tempest-TestMinimumBasicScenario-1577532672 None] Acquiring lock "cinder-quobyte-a96b1af0-dc39-45b8-b72e-cb0489bef5ce" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:45:25 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c6cd3b93-43df-4e2e-8705-8622f58e47c3 tempest-TestMinimumBasicScenario-1577532672 None] Lock "cinder-quobyte-a96b1af0-dc39-45b8-b72e-cb0489bef5ce" acquired by "delete_volume" :: waited 0.017s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:45:25 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c00a24-dbc7-4d5e-9bdc-8917f84aed60]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:45:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c6cd3b93-43df-4e2e-8705-8622f58e47c3 tempest-TestMinimumBasicScenario-1577532672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a96b1af0-dc39-45b8-b72e-cb0489bef5ce {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:25 devstack sudo[104608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a96b1af0-dc39-45b8-b72e-cb0489bef5ce Jun 04 06:45:25 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:26 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c6cd3b93-43df-4e2e-8705-8622f58e47c3 tempest-TestMinimumBasicScenario-1577532672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a96b1af0-dc39-45b8-b72e-cb0489bef5ce" returned: 0 in 0.769s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c6cd3b93-43df-4e2e-8705-8622f58e47c3 tempest-TestMinimumBasicScenario-1577532672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a96b1af0-dc39-45b8-b72e-cb0489bef5ce {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:26 devstack sudo[104622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a96b1af0-dc39-45b8-b72e-cb0489bef5ce Jun 04 06:45:26 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:27 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c6cd3b93-43df-4e2e-8705-8622f58e47c3 tempest-TestMinimumBasicScenario-1577532672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a96b1af0-dc39-45b8-b72e-cb0489bef5ce" returned: 0 in 1.443s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c6cd3b93-43df-4e2e-8705-8622f58e47c3 tempest-TestMinimumBasicScenario-1577532672 None] Lock "cinder-quobyte-a96b1af0-dc39-45b8-b72e-cb0489bef5ce" released by "delete_volume" :: held 2.282s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:45:27 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-c6cd3b93-43df-4e2e-8705-8622f58e47c3 tempest-TestMinimumBasicScenario-1577532672 None] Created reservations ['3fa6f1c5-9132-413b-b82c-930313c80cc2', '8a6d2490-9c92-41b9-91b6-0035dcde9e3d', 'b21acf8a-1d65-40f6-9750-7bc5fb593890', '2dc468f7-b6c9-4517-8625-4697272a3a01'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:45:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c6cd3b93-43df-4e2e-8705-8622f58e47c3 tempest-TestMinimumBasicScenario-1577532672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:45:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c6cd3b93-43df-4e2e-8705-8622f58e47c3 tempest-TestMinimumBasicScenario-1577532672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:45:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c6cd3b93-43df-4e2e-8705-8622f58e47c3 tempest-TestMinimumBasicScenario-1577532672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:45:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c6cd3b93-43df-4e2e-8705-8622f58e47c3 tempest-TestMinimumBasicScenario-1577532672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:45:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c6cd3b93-43df-4e2e-8705-8622f58e47c3 tempest-TestMinimumBasicScenario-1577532672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:45:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c6cd3b93-43df-4e2e-8705-8622f58e47c3 tempest-TestMinimumBasicScenario-1577532672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:27 devstack sudo[104627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:45:27 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:28 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c6cd3b93-43df-4e2e-8705-8622f58e47c3 tempest-TestMinimumBasicScenario-1577532672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.132s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:28 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-c6cd3b93-43df-4e2e-8705-8622f58e47c3 tempest-TestMinimumBasicScenario-1577532672 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:45:29 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-c6cd3b93-43df-4e2e-8705-8622f58e47c3 tempest-TestMinimumBasicScenario-1577532672 None] Deleted volume successfully. Jun 04 06:45:29 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c6cd3b93-43df-4e2e-8705-8622f58e47c3 tempest-TestMinimumBasicScenario-1577532672 None] Lock "cinder-a96b1af0-dc39-45b8-b72e-cb0489bef5ce-delete_volume" released by "delete_volume" :: held 3.864s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:45:30 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-984977bb-9984-430c-a957-0a0514d91bb4" returned: 0 in 5.672s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:30 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[14691221-34f9-441d-9a54-00bd757d2272]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:45:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:31 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324 Jun 04 06:45:31 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:31 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324" returned: 0 in 0.945s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:31 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Image conversion details: src /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324, size 1024.00 MB, duration 5.67 sec, destination /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-984977bb-9984-430c-a957-0a0514d91bb4 {{(pid=86069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 06:45:31 devstack cinder-volume[86069]: INFO cinder.image.image_utils [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Converted 1024.00 MB image at 180.49 MB/s Jun 04 06:45:31 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-984977bb-9984-430c-a957-0a0514d91bb4 is being set with open permissions: ugo+rw Jun 04 06:45:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-984977bb-9984-430c-a957-0a0514d91bb4 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:31 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-984977bb-9984-430c-a957-0a0514d91bb4 Jun 04 06:45:31 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:32 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-984977bb-9984-430c-a957-0a0514d91bb4" returned: 0 in 0.670s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:32 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Lock "cinder-quobyte-984977bb-9984-430c-a957-0a0514d91bb4" released by "_copy_volume_from_snapshot" :: held 8.855s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:45:32 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Lock "cinder-quobyte-f8fbbbab-6785-4df4-b861-be16c39bec06-984977bb-9984-430c-a957-0a0514d91bb4" released by "_create_volume_from_snapshot" :: held 8.884s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:45:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.902s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:45:32 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4f4b368-04a0-4279-8b47-f4ed90f937bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-984977bb-9984-430c-a957-0a0514d91bb4', 'volume_size': 1, 'snapshot_id': 'f8fbbbab-6785-4df4-b861-be16c39bec06'}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:45:32 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a42058d-6500-4d59-83de-d4aab38ee0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:45:32 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Volume volume-984977bb-9984-430c-a957-0a0514d91bb4 (984977bb-9984-430c-a957-0a0514d91bb4): created successfully Jun 04 06:45:32 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a42058d-6500-4d59-83de-d4aab38ee0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:45:32 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Flow 'volume_create_manager' (2f03147a-711b-415e-8530-b7b8015131bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:45:32 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-f28e3947-c42f-406d-85ef-81a2743dd2e8 tempest-VolumeDependencyTests-1772867454 None] Created volume successfully. Jun 04 06:45:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-dae1294e-79a1-4b37-9827-55b53b978e8f tempest-VolumeDependencyTests-1772867454 None] Acquiring lock "cinder-f8fbbbab-6785-4df4-b861-be16c39bec06-delete_snapshot" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:45:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-dae1294e-79a1-4b37-9827-55b53b978e8f tempest-VolumeDependencyTests-1772867454 None] Lock "cinder-f8fbbbab-6785-4df4-b861-be16c39bec06-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:45:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-dae1294e-79a1-4b37-9827-55b53b978e8f tempest-VolumeDependencyTests-1772867454 None] Acquiring lock "cinder-quobyte-fb514c4a-eb12-432a-8ff1-bc7811e66324" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:45:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-dae1294e-79a1-4b37-9827-55b53b978e8f tempest-VolumeDependencyTests-1772867454 None] Lock "cinder-quobyte-fb514c4a-eb12-432a-8ff1-bc7811e66324" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:45:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-dae1294e-79a1-4b37-9827-55b53b978e8f tempest-VolumeDependencyTests-1772867454 None] Acquiring lock "cinder-quobyte-f8fbbbab-6785-4df4-b861-be16c39bec06" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:45:33 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-dae1294e-79a1-4b37-9827-55b53b978e8f tempest-VolumeDependencyTests-1772867454 None] Lock "cinder-quobyte-f8fbbbab-6785-4df4-b861-be16c39bec06" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:45:33 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-dae1294e-79a1-4b37-9827-55b53b978e8f tempest-VolumeDependencyTests-1772867454 None] Deleting offline snapshot f8fbbbab-6785-4df4-b861-be16c39bec06 of volume fb514c4a-eb12-432a-8ff1-bc7811e66324 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:45:33 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-dae1294e-79a1-4b37-9827-55b53b978e8f tempest-VolumeDependencyTests-1772867454 None] snapshot_file for this snap is: volume-fb514c4a-eb12-432a-8ff1-bc7811e66324.f8fbbbab-6785-4df4-b861-be16c39bec06 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:45:33 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a912878-8a3c-4c84-a1a6-374d2a21bad4]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:45:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dae1294e-79a1-4b37-9827-55b53b978e8f tempest-VolumeDependencyTests-1772867454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324.f8fbbbab-6785-4df4-b861-be16c39bec06 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:33 devstack sudo[104681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324.f8fbbbab-6785-4df4-b861-be16c39bec06 Jun 04 06:45:33 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:34 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dae1294e-79a1-4b37-9827-55b53b978e8f tempest-VolumeDependencyTests-1772867454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324.f8fbbbab-6785-4df4-b861-be16c39bec06" returned: 0 in 0.714s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-dae1294e-79a1-4b37-9827-55b53b978e8f tempest-VolumeDependencyTests-1772867454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb514c4a-eb12-432a-8ff1-bc7811e66324(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:45:34 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd211398-7103-4039-bf24-dc7a64fe0ab0]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:45:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dae1294e-79a1-4b37-9827-55b53b978e8f tempest-VolumeDependencyTests-1772867454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:34 devstack sudo[104686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324 Jun 04 06:45:34 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:35 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dae1294e-79a1-4b37-9827-55b53b978e8f tempest-VolumeDependencyTests-1772867454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324" returned: 0 in 0.707s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dae1294e-79a1-4b37-9827-55b53b978e8f tempest-VolumeDependencyTests-1772867454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324.f8fbbbab-6785-4df4-b861-be16c39bec06 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:35 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324.f8fbbbab-6785-4df4-b861-be16c39bec06 Jun 04 06:45:35 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:35 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dae1294e-79a1-4b37-9827-55b53b978e8f tempest-VolumeDependencyTests-1772867454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324.f8fbbbab-6785-4df4-b861-be16c39bec06" returned: 0 in 0.761s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dae1294e-79a1-4b37-9827-55b53b978e8f tempest-VolumeDependencyTests-1772867454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324.f8fbbbab-6785-4df4-b861-be16c39bec06 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:35 devstack sudo[104738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324.f8fbbbab-6785-4df4-b861-be16c39bec06 Jun 04 06:45:35 devstack sudo[104738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:36 devstack sudo[104738]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dae1294e-79a1-4b37-9827-55b53b978e8f tempest-VolumeDependencyTests-1772867454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324.f8fbbbab-6785-4df4-b861-be16c39bec06" returned: 0 in 0.633s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:36 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-dae1294e-79a1-4b37-9827-55b53b978e8f tempest-VolumeDependencyTests-1772867454 None] Lock "cinder-quobyte-f8fbbbab-6785-4df4-b861-be16c39bec06" released by "_delete_snapshot" :: held 2.926s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:45:36 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-dae1294e-79a1-4b37-9827-55b53b978e8f tempest-VolumeDependencyTests-1772867454 None] Lock "cinder-quobyte-fb514c4a-eb12-432a-8ff1-bc7811e66324" released by "delete_snapshot" :: held 2.953s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:45:36 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-dae1294e-79a1-4b37-9827-55b53b978e8f tempest-VolumeDependencyTests-1772867454 None] Created reservations ['b32dee22-7c54-4ed8-849b-4bca744724c1', 'f905e048-def8-4274-9e56-a84d37332e83', '968de430-4e41-4b3f-b0bc-1257e75996c1', '7bfde00f-2df3-47ad-9586-37d6dd27b19d'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:45:36 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-dae1294e-79a1-4b37-9827-55b53b978e8f tempest-VolumeDependencyTests-1772867454 None] Delete snapshot completed successfully. Jun 04 06:45:36 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-dae1294e-79a1-4b37-9827-55b53b978e8f tempest-VolumeDependencyTests-1772867454 None] Lock "cinder-f8fbbbab-6785-4df4-b861-be16c39bec06-delete_snapshot" released by "delete_snapshot" :: held 3.117s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:45:36 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-558e16cb-ce16-4ea4-8951-77f40913f3e6 tempest-VolumeDependencyTests-1772867454 None] Acquiring lock "cinder-fb514c4a-eb12-432a-8ff1-bc7811e66324-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:45:36 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-558e16cb-ce16-4ea4-8951-77f40913f3e6 tempest-VolumeDependencyTests-1772867454 None] Lock "cinder-fb514c4a-eb12-432a-8ff1-bc7811e66324-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:45:36 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-558e16cb-ce16-4ea4-8951-77f40913f3e6 tempest-VolumeDependencyTests-1772867454 None] Acquiring lock "cinder-quobyte-fb514c4a-eb12-432a-8ff1-bc7811e66324" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:45:36 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-558e16cb-ce16-4ea4-8951-77f40913f3e6 tempest-VolumeDependencyTests-1772867454 None] Lock "cinder-quobyte-fb514c4a-eb12-432a-8ff1-bc7811e66324" acquired by "delete_volume" :: waited 0.021s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:45:36 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[000f8cbf-85aa-4aab-9fb1-ca56ed48f863]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:45:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-558e16cb-ce16-4ea4-8951-77f40913f3e6 tempest-VolumeDependencyTests-1772867454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:36 devstack sudo[104741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324 Jun 04 06:45:36 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:37 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-558e16cb-ce16-4ea4-8951-77f40913f3e6 tempest-VolumeDependencyTests-1772867454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324" returned: 0 in 0.839s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-558e16cb-ce16-4ea4-8951-77f40913f3e6 tempest-VolumeDependencyTests-1772867454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:37 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324 Jun 04 06:45:37 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:38 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-558e16cb-ce16-4ea4-8951-77f40913f3e6 tempest-VolumeDependencyTests-1772867454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-fb514c4a-eb12-432a-8ff1-bc7811e66324" returned: 0 in 0.604s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:38 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-558e16cb-ce16-4ea4-8951-77f40913f3e6 tempest-VolumeDependencyTests-1772867454 None] Lock "cinder-quobyte-fb514c4a-eb12-432a-8ff1-bc7811e66324" released by "delete_volume" :: held 1.512s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:45:38 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-558e16cb-ce16-4ea4-8951-77f40913f3e6 tempest-VolumeDependencyTests-1772867454 None] Created reservations ['8316151b-22a0-4ffb-8c4a-2f347eafb18d', '83935af3-71c2-45c5-8d57-68061ff3d10f', 'a83b1dc0-d65c-424a-a740-d51dc0836f3d', '1a3f44d3-7282-406c-90f2-ada3f540980d'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:45:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-558e16cb-ce16-4ea4-8951-77f40913f3e6 tempest-VolumeDependencyTests-1772867454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:45:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-558e16cb-ce16-4ea4-8951-77f40913f3e6 tempest-VolumeDependencyTests-1772867454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:45:38 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-558e16cb-ce16-4ea4-8951-77f40913f3e6 tempest-VolumeDependencyTests-1772867454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:45:38 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-558e16cb-ce16-4ea4-8951-77f40913f3e6 tempest-VolumeDependencyTests-1772867454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:45:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-558e16cb-ce16-4ea4-8951-77f40913f3e6 tempest-VolumeDependencyTests-1772867454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:45:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-558e16cb-ce16-4ea4-8951-77f40913f3e6 tempest-VolumeDependencyTests-1772867454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:38 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:45:38 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6c42fdf1-86c1-49dc-9d2a-ff67c304bbda tempest-VolumeDependencyTests-1772867454 None] Acquiring lock "cinder-984977bb-9984-430c-a957-0a0514d91bb4-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:45:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6c42fdf1-86c1-49dc-9d2a-ff67c304bbda tempest-VolumeDependencyTests-1772867454 None] Lock "cinder-984977bb-9984-430c-a957-0a0514d91bb4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:45:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6c42fdf1-86c1-49dc-9d2a-ff67c304bbda tempest-VolumeDependencyTests-1772867454 None] Acquiring lock "cinder-quobyte-984977bb-9984-430c-a957-0a0514d91bb4" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:45:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6c42fdf1-86c1-49dc-9d2a-ff67c304bbda tempest-VolumeDependencyTests-1772867454 None] Lock "cinder-quobyte-984977bb-9984-430c-a957-0a0514d91bb4" acquired by "delete_volume" :: waited 0.016s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:45:39 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a50a3c4-a9d2-4f95-a9da-81fbb36fcb6c]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:45:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6c42fdf1-86c1-49dc-9d2a-ff67c304bbda tempest-VolumeDependencyTests-1772867454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-984977bb-9984-430c-a957-0a0514d91bb4 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:39 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-558e16cb-ce16-4ea4-8951-77f40913f3e6 tempest-VolumeDependencyTests-1772867454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.718s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:39 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-558e16cb-ce16-4ea4-8951-77f40913f3e6 tempest-VolumeDependencyTests-1772867454 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:45:39 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-558e16cb-ce16-4ea4-8951-77f40913f3e6 tempest-VolumeDependencyTests-1772867454 None] Deleted volume successfully. Jun 04 06:45:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-558e16cb-ce16-4ea4-8951-77f40913f3e6 tempest-VolumeDependencyTests-1772867454 None] Lock "cinder-fb514c4a-eb12-432a-8ff1-bc7811e66324-delete_volume" released by "delete_volume" :: held 2.459s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:45:39 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-984977bb-9984-430c-a957-0a0514d91bb4 Jun 04 06:45:39 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:39 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6c42fdf1-86c1-49dc-9d2a-ff67c304bbda tempest-VolumeDependencyTests-1772867454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-984977bb-9984-430c-a957-0a0514d91bb4" returned: 0 in 0.784s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6c42fdf1-86c1-49dc-9d2a-ff67c304bbda tempest-VolumeDependencyTests-1772867454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-984977bb-9984-430c-a957-0a0514d91bb4 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:39 devstack sudo[104760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-984977bb-9984-430c-a957-0a0514d91bb4 Jun 04 06:45:39 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:40 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6c42fdf1-86c1-49dc-9d2a-ff67c304bbda tempest-VolumeDependencyTests-1772867454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-984977bb-9984-430c-a957-0a0514d91bb4" returned: 0 in 0.659s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:40 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6c42fdf1-86c1-49dc-9d2a-ff67c304bbda tempest-VolumeDependencyTests-1772867454 None] Lock "cinder-quobyte-984977bb-9984-430c-a957-0a0514d91bb4" released by "delete_volume" :: held 1.493s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:45:40 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-6c42fdf1-86c1-49dc-9d2a-ff67c304bbda tempest-VolumeDependencyTests-1772867454 None] Created reservations ['9ba4ce97-7488-4cfe-8bef-f5d0af7ce0de', 'ffb287e4-c2b7-405f-a0db-b363417c1939', '59db7d87-a375-4249-8b32-62c47fc31ba3', '1e979684-9875-4009-9845-9880b93a7866'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:45:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-6c42fdf1-86c1-49dc-9d2a-ff67c304bbda tempest-VolumeDependencyTests-1772867454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:45:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-6c42fdf1-86c1-49dc-9d2a-ff67c304bbda tempest-VolumeDependencyTests-1772867454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:45:40 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-6c42fdf1-86c1-49dc-9d2a-ff67c304bbda tempest-VolumeDependencyTests-1772867454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:45:40 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-6c42fdf1-86c1-49dc-9d2a-ff67c304bbda tempest-VolumeDependencyTests-1772867454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:45:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-6c42fdf1-86c1-49dc-9d2a-ff67c304bbda tempest-VolumeDependencyTests-1772867454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:45:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6c42fdf1-86c1-49dc-9d2a-ff67c304bbda tempest-VolumeDependencyTests-1772867454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:45:40 devstack sudo[104763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:45:40 devstack sudo[104763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:45:41 devstack sudo[104763]: pam_unix(sudo:session): session closed for user root Jun 04 06:45:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-6c42fdf1-86c1-49dc-9d2a-ff67c304bbda tempest-VolumeDependencyTests-1772867454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.640s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:45:41 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-6c42fdf1-86c1-49dc-9d2a-ff67c304bbda tempest-VolumeDependencyTests-1772867454 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:45:41 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-6c42fdf1-86c1-49dc-9d2a-ff67c304bbda tempest-VolumeDependencyTests-1772867454 None] Deleted volume successfully. Jun 04 06:45:41 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-6c42fdf1-86c1-49dc-9d2a-ff67c304bbda tempest-VolumeDependencyTests-1772867454 None] Lock "cinder-984977bb-9984-430c-a957-0a0514d91bb4-delete_volume" released by "delete_volume" :: held 2.364s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:45:50 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:DELETE=2,cinder:SELECT=21,cinder:UPDATE=32,cinder:INSERT=10 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:45:51 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=30,cinder:UPDATE=33,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:46:08 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:46:08 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] Flow 'volume_create_manager' (98221204-8ceb-4e63-ab5f-95df5a955e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:46:08 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f49f3e81-9a69-463d-b069-3a418105141d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:46:08 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f49f3e81-9a69-463d-b069-3a418105141d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1293811092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a767e8-5ee4-49df-a6e6-1e7d77929a35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8246c57ce746453d8064b094403331bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:46:09Z,use_quota=True,user_id='b2aeec87ed054696ab4f4087a57945b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:46:08 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad3596c0-9a40-44a7-9281-a86bef28b9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:46:08 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad3596c0-9a40-44a7-9281-a86bef28b9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:46:08 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac07231f-b69e-4cb5-8fa3-2bd37deb9e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:46:08 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac07231f-b69e-4cb5-8fa3-2bd37deb9e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7a767e8-5ee4-49df-a6e6-1e7d77929a35', 'volume_name': 'volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:46:08 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c547e342-b9e5-4b06-a579-e144d885cf18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:46:08 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c547e342-b9e5-4b06-a579-e144d885cf18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:46:08 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b869374-14b4-430d-b6f9-41a08c737141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:46:08 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] Volume e7a767e8-5ee4-49df-a6e6-1e7d77929a35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35', 'volume_size': 1} Jun 04 06:46:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:46:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:46:08 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1293811092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a767e8-5ee4-49df-a6e6-1e7d77929a35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8246c57ce746453d8064b094403331bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:46:09Z,use_quota=True,user_id='b2aeec87ed054696ab4f4087a57945b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:46:08 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] Creating volume e7a767e8-5ee4-49df-a6e6-1e7d77929a35 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:46:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:46:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:46:08 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:46:08 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:46:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:46:08 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:46:08 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:46:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:46:08 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35 1073741824 Jun 04 06:46:08 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:46:09 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Jun 04 06:46:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35 1073741824" returned: 0 in 0.869s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:46:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:46:09 devstack sudo[104782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35 Jun 04 06:46:09 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:46:10 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root Jun 04 06:46:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35" returned: 0 in 0.693s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:46:10 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:46:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:46:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b869374-14b4-430d-b6f9-41a08c737141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:46:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984459a4-a1c6-4d3b-9726-fb2f33b611df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:46:10 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] Volume volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35 (e7a767e8-5ee4-49df-a6e6-1e7d77929a35): created successfully Jun 04 06:46:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984459a4-a1c6-4d3b-9726-fb2f33b611df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:46:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] Flow 'volume_create_manager' (98221204-8ceb-4e63-ab5f-95df5a955e00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:46:10 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-e8fe3f90-e0a7-4f26-bbd4-b454ee1b2fb2 tempest-TestStampPattern-209527487 None] Created volume successfully. Jun 04 06:46:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:46:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:46:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:46:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:46:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:46:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:46:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:46:11 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:46:11 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:46:11 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Jun 04 06:46:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.630s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:46:11 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:46:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager._thread_info {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:46:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread count: 28 {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 06:46:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread info: [<_MainThread(MainThread, started 131797370544256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 06:46:20 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:46:20 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:46:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-2433a2b7-13c3-4bcb-8f11-fa4fca6ea0b5 req-3fff3a04-0d4a-4c8e-a1a6-7e93a0416ea9 tempest-TestStampPattern-209527487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:46:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-2433a2b7-13c3-4bcb-8f11-fa4fca6ea0b5 req-3fff3a04-0d4a-4c8e-a1a6-7e93a0416ea9 tempest-TestStampPattern-209527487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:46:49 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf89e47-27a8-4aba-82f7-d89b9cc7d014]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:46:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-2433a2b7-13c3-4bcb-8f11-fa4fca6ea0b5 req-3fff3a04-0d4a-4c8e-a1a6-7e93a0416ea9 tempest-TestStampPattern-209527487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:46:49 devstack sudo[104950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35 Jun 04 06:46:49 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:46:50 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root Jun 04 06:46:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-2433a2b7-13c3-4bcb-8f11-fa4fca6ea0b5 req-3fff3a04-0d4a-4c8e-a1a6-7e93a0416ea9 tempest-TestStampPattern-209527487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35" returned: 0 in 0.725s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:46:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-2433a2b7-13c3-4bcb-8f11-fa4fca6ea0b5 req-3fff3a04-0d4a-4c8e-a1a6-7e93a0416ea9 tempest-TestStampPattern-209527487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.746s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:46:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-2433a2b7-13c3-4bcb-8f11-fa4fca6ea0b5 req-3fff3a04-0d4a-4c8e-a1a6-7e93a0416ea9 tempest-TestStampPattern-209527487 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574', 'name': 'volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '320e6825-5d08-40f9-a176-729227076467', 'enforce_multipath': True} {{(pid=86069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 06:46:50 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-2433a2b7-13c3-4bcb-8f11-fa4fca6ea0b5 req-3fff3a04-0d4a-4c8e-a1a6-7e93a0416ea9 tempest-TestStampPattern-209527487 None] attachment_update completed successfully. Jun 04 06:46:58 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-f119bab3-9d4b-4e74-b510-567b301d06e6 req-47459aa8-d1e0-46ca-89e0-c36ceb77939d tempest-TestStampPattern-209527487 None] Terminate volume connection completed successfully. Jun 04 06:46:58 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-f119bab3-9d4b-4e74-b510-567b301d06e6 req-47459aa8-d1e0-46ca-89e0-c36ceb77939d tempest-TestStampPattern-209527487 None] Deleting attachment 320e6825-5d08-40f9-a176-729227076467. {{(pid=86069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 06:47:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-79f4e84d-355c-4a9d-bec0-c40da41f8ddf tempest-TestStampPattern-209527487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:47:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-79f4e84d-355c-4a9d-bec0-c40da41f8ddf tempest-TestStampPattern-209527487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:47:00 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-79f4e84d-355c-4a9d-bec0-c40da41f8ddf tempest-TestStampPattern-209527487 None] Creating offline snapshot fc170624-f437-41a7-b36f-a763dd514a85 of volume e7a767e8-5ee4-49df-a6e6-1e7d77929a35 {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:47:00 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[1875a1c4-b90d-41e4-8158-faf473ead302]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:47:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-79f4e84d-355c-4a9d-bec0-c40da41f8ddf tempest-TestStampPattern-209527487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:47:00 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35 Jun 04 06:47:00 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:47:01 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Jun 04 06:47:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-79f4e84d-355c-4a9d-bec0-c40da41f8ddf tempest-TestStampPattern-209527487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35" returned: 0 in 0.769s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:47:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-79f4e84d-355c-4a9d-bec0-c40da41f8ddf tempest-TestStampPattern-209527487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35.fc170624-f437-41a7-b36f-a763dd514a85 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:47:01 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35.fc170624-f437-41a7-b36f-a763dd514a85 1G Jun 04 06:47:01 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:47:02 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Jun 04 06:47:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-79f4e84d-355c-4a9d-bec0-c40da41f8ddf tempest-TestStampPattern-209527487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35.fc170624-f437-41a7-b36f-a763dd514a85 1G" returned: 0 in 0.808s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:47:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-79f4e84d-355c-4a9d-bec0-c40da41f8ddf tempest-TestStampPattern-209527487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35.fc170624-f437-41a7-b36f-a763dd514a85 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:47:02 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35.fc170624-f437-41a7-b36f-a763dd514a85 Jun 04 06:47:02 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:47:03 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Jun 04 06:47:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-79f4e84d-355c-4a9d-bec0-c40da41f8ddf tempest-TestStampPattern-209527487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35.fc170624-f437-41a7-b36f-a763dd514a85" returned: 0 in 0.651s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:47:03 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-79f4e84d-355c-4a9d-bec0-c40da41f8ddf tempest-TestStampPattern-209527487 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35.fc170624-f437-41a7-b36f-a763dd514a85 is being set with open permissions: ugo+rw Jun 04 06:47:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-79f4e84d-355c-4a9d-bec0-c40da41f8ddf tempest-TestStampPattern-209527487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35.fc170624-f437-41a7-b36f-a763dd514a85 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:47:03 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35.fc170624-f437-41a7-b36f-a763dd514a85 Jun 04 06:47:03 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:47:03 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Jun 04 06:47:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-79f4e84d-355c-4a9d-bec0-c40da41f8ddf tempest-TestStampPattern-209527487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35.fc170624-f437-41a7-b36f-a763dd514a85" returned: 0 in 0.576s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:47:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-79f4e84d-355c-4a9d-bec0-c40da41f8ddf tempest-TestStampPattern-209527487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:47:03 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35.info Jun 04 06:47:03 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:47:04 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Jun 04 06:47:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-79f4e84d-355c-4a9d-bec0-c40da41f8ddf tempest-TestStampPattern-209527487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35.info" returned: 0 in 0.612s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:47:04 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-79f4e84d-355c-4a9d-bec0-c40da41f8ddf tempest-TestStampPattern-209527487 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35.info is being set with open permissions: ugo+rw Jun 04 06:47:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-79f4e84d-355c-4a9d-bec0-c40da41f8ddf tempest-TestStampPattern-209527487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:47:04 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35.info Jun 04 06:47:04 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:47:04 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Jun 04 06:47:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-79f4e84d-355c-4a9d-bec0-c40da41f8ddf tempest-TestStampPattern-209527487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35.info" returned: 0 in 0.596s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:47:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-79f4e84d-355c-4a9d-bec0-c40da41f8ddf tempest-TestStampPattern-209527487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.097s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:47:04 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-79f4e84d-355c-4a9d-bec0-c40da41f8ddf tempest-TestStampPattern-209527487 None] Create snapshot completed successfully Jun 04 06:47:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:47:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:47:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:47:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:47:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:47:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:47:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:47:11 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:47:11 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:47:11 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Jun 04 06:47:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.665s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:47:11 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:47:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager._thread_info {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:47:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread count: 28 {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 06:47:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread info: [<_MainThread(MainThread, started 131797370544256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 06:47:14 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:47:14 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:47:15 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:47:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Flow 'volume_create_manager' (1d95c5f2-3249-4dab-ae69-06a6a892484e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:47:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9440ce-f353-440c-b3e8-8540fcd1c176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:47:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9440ce-f353-440c-b3e8-8540fcd1c176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-751676062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a40be28d-67bc-48d2-b730-f5ddebb870c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8246c57ce746453d8064b094403331bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fc170624-f437-41a7-b36f-a763dd514a85,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:47:15Z,use_quota=True,user_id='b2aeec87ed054696ab4f4087a57945b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:47:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9685a627-9587-4fb7-9d28-915dab87e2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:47:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9685a627-9587-4fb7-9d28-915dab87e2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:47:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d79b1597-f1ab-4fae-8d68-9907ca49b58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:47:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d79b1597-f1ab-4fae-8d68-9907ca49b58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a40be28d-67bc-48d2-b730-f5ddebb870c8', 'volume_name': 'volume-a40be28d-67bc-48d2-b730-f5ddebb870c8', 'volume_size': 1, 'snapshot_id': 'fc170624-f437-41a7-b36f-a763dd514a85'}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:47:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (844ad19d-b3b1-433f-89c1-2f82402c98c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:47:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (844ad19d-b3b1-433f-89c1-2f82402c98c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:47:15 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (526bc1ae-7970-4adf-8560-e534f05c812e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:47:15 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Volume a40be28d-67bc-48d2-b730-f5ddebb870c8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a40be28d-67bc-48d2-b730-f5ddebb870c8', 'volume_size': 1, 'snapshot_id': 'fc170624-f437-41a7-b36f-a763dd514a85'} Jun 04 06:47:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:47:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:47:15 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Acquiring lock "cinder-quobyte-fc170624-f437-41a7-b36f-a763dd514a85-a40be28d-67bc-48d2-b730-f5ddebb870c8" by "_create_volume_from_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:47:15 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Lock "cinder-quobyte-fc170624-f437-41a7-b36f-a763dd514a85-a40be28d-67bc-48d2-b730-f5ddebb870c8" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:47:15 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Creating volume a40be28d-67bc-48d2-b730-f5ddebb870c8 from snapshot fc170624-f437-41a7-b36f-a763dd514a85 {{(pid=86069) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 04 06:47:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:47:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:47:15 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:47:15 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:47:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:47:15 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:47:15 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Acquiring lock "cinder-quobyte-a40be28d-67bc-48d2-b730-f5ddebb870c8" by "_copy_volume_from_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:47:15 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Lock "cinder-quobyte-a40be28d-67bc-48d2-b730-f5ddebb870c8" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:47:15 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] snapshot: fc170624-f437-41a7-b36f-a763dd514a85, volume: a40be28d-67bc-48d2-b730-f5ddebb870c8, {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 06:47:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:47:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:47:15 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:47:15 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:47:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:47:15 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[0036b5e0-de1c-4115-9943-dbf5fc0bcae7]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:47:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35.fc170624-f437-41a7-b36f-a763dd514a85 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:47:15 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35.fc170624-f437-41a7-b36f-a763dd514a85 Jun 04 06:47:15 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:47:16 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Jun 04 06:47:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35.fc170624-f437-41a7-b36f-a763dd514a85" returned: 0 in 0.773s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:47:16 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:47:16 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35 {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 06:47:16 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Creating direct copy from snapshot {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 06:47:16 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e07972-e4d5-49a8-a26d-a99893d13fea]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:47:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:47:16 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35 Jun 04 06:47:16 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:47:17 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Jun 04 06:47:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35" returned: 0 in 0.731s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:47:17 devstack cinder-volume[86069]: DEBUG cinder.utils [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Path /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a40be28d-67bc-48d2-b730-f5ddebb870c8 not found in is_blk_device check {{(pid=86069) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 04 06:47:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a40be28d-67bc-48d2-b730-f5ddebb870c8 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:47:17 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a40be28d-67bc-48d2-b730-f5ddebb870c8 Jun 04 06:47:17 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:47:22 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Jun 04 06:47:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a40be28d-67bc-48d2-b730-f5ddebb870c8" returned: 0 in 5.146s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:47:22 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2bd35ce-4f9e-427d-a0d8-223807b6def6]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:47:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:47:22 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35 Jun 04 06:47:22 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:47:23 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Jun 04 06:47:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35" returned: 0 in 1.197s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:47:23 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Image conversion details: src /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35, size 1024.00 MB, duration 5.15 sec, destination /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a40be28d-67bc-48d2-b730-f5ddebb870c8 {{(pid=86069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 06:47:23 devstack cinder-volume[86069]: INFO cinder.image.image_utils [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Converted 1024.00 MB image at 198.95 MB/s Jun 04 06:47:23 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a40be28d-67bc-48d2-b730-f5ddebb870c8 is being set with open permissions: ugo+rw Jun 04 06:47:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a40be28d-67bc-48d2-b730-f5ddebb870c8 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:47:23 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a40be28d-67bc-48d2-b730-f5ddebb870c8 Jun 04 06:47:23 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:47:24 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Jun 04 06:47:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a40be28d-67bc-48d2-b730-f5ddebb870c8" returned: 0 in 0.683s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:47:24 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Lock "cinder-quobyte-a40be28d-67bc-48d2-b730-f5ddebb870c8" released by "_copy_volume_from_snapshot" :: held 8.650s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:47:24 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Lock "cinder-quobyte-fc170624-f437-41a7-b36f-a763dd514a85-a40be28d-67bc-48d2-b730-f5ddebb870c8" released by "_create_volume_from_snapshot" :: held 8.693s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:47:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.710s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:47:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (526bc1ae-7970-4adf-8560-e534f05c812e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a40be28d-67bc-48d2-b730-f5ddebb870c8', 'volume_size': 1, 'snapshot_id': 'fc170624-f437-41a7-b36f-a763dd514a85'}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:47:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88d87a90-3b5a-4302-b28f-f27f664fd7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:47:24 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Volume volume-a40be28d-67bc-48d2-b730-f5ddebb870c8 (a40be28d-67bc-48d2-b730-f5ddebb870c8): created successfully Jun 04 06:47:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88d87a90-3b5a-4302-b28f-f27f664fd7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:47:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Flow 'volume_create_manager' (1d95c5f2-3249-4dab-ae69-06a6a892484e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:47:24 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-aabae41b-6770-4bbd-b5a8-53c0a3569a81 tempest-TestStampPattern-209527487 None] Created volume successfully. Jun 04 06:47:34 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:UPDATE=3,cinder:SELECT=3 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:47:34 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:47:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-f6a70ad1-7e61-4905-a065-1f434af19cb3 req-a2b2c091-ec67-49a7-99c8-242601361068 tempest-TestStampPattern-209527487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:47:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-f6a70ad1-7e61-4905-a065-1f434af19cb3 req-a2b2c091-ec67-49a7-99c8-242601361068 tempest-TestStampPattern-209527487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:47:58 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[2067eab7-8e86-4cf2-92f5-213076e5fa55]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:47:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-f6a70ad1-7e61-4905-a065-1f434af19cb3 req-a2b2c091-ec67-49a7-99c8-242601361068 tempest-TestStampPattern-209527487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a40be28d-67bc-48d2-b730-f5ddebb870c8 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:47:58 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a40be28d-67bc-48d2-b730-f5ddebb870c8 Jun 04 06:47:58 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:47:59 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Jun 04 06:47:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [req-f6a70ad1-7e61-4905-a065-1f434af19cb3 req-a2b2c091-ec67-49a7-99c8-242601361068 tempest-TestStampPattern-209527487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a40be28d-67bc-48d2-b730-f5ddebb870c8" returned: 0 in 0.755s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:47:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [req-f6a70ad1-7e61-4905-a065-1f434af19cb3 req-a2b2c091-ec67-49a7-99c8-242601361068 tempest-TestStampPattern-209527487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.773s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:47:59 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-f6a70ad1-7e61-4905-a065-1f434af19cb3 req-a2b2c091-ec67-49a7-99c8-242601361068 tempest-TestStampPattern-209527487 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574', 'name': 'volume-a40be28d-67bc-48d2-b730-f5ddebb870c8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '40a3288d-35d5-4f90-aad5-e3e92ccea13e', 'enforce_multipath': True} {{(pid=86069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 06:47:59 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-f6a70ad1-7e61-4905-a065-1f434af19cb3 req-a2b2c091-ec67-49a7-99c8-242601361068 tempest-TestStampPattern-209527487 None] attachment_update completed successfully. Jun 04 06:48:05 devstack cinder-volume[86069]: INFO cinder.volume.manager [req-b645bafc-904f-4039-844d-d9423c9632d6 req-9b07b7d7-66f9-45de-8cd3-f9d373268355 tempest-TestStampPattern-209527487 None] Terminate volume connection completed successfully. Jun 04 06:48:05 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [req-b645bafc-904f-4039-844d-d9423c9632d6 req-9b07b7d7-66f9-45de-8cd3-f9d373268355 tempest-TestStampPattern-209527487 None] Deleting attachment 40a3288d-35d5-4f90-aad5-e3e92ccea13e. {{(pid=86069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 06:48:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:48:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:48:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:48:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:48:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:48:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:48:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:11 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:48:11 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:11 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.584s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:11 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:48:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager._thread_info {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:48:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread count: 28 {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 06:48:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread info: [<_MainThread(MainThread, started 131797370544256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 06:48:14 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ee2afb8d-af42-4e6f-a2cb-ed1b7467e3ef tempest-TestStampPattern-209527487 None] Acquiring lock "cinder-a40be28d-67bc-48d2-b730-f5ddebb870c8-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:48:14 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ee2afb8d-af42-4e6f-a2cb-ed1b7467e3ef tempest-TestStampPattern-209527487 None] Lock "cinder-a40be28d-67bc-48d2-b730-f5ddebb870c8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:48:14 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ee2afb8d-af42-4e6f-a2cb-ed1b7467e3ef tempest-TestStampPattern-209527487 None] Acquiring lock "cinder-quobyte-a40be28d-67bc-48d2-b730-f5ddebb870c8" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:48:14 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ee2afb8d-af42-4e6f-a2cb-ed1b7467e3ef tempest-TestStampPattern-209527487 None] Lock "cinder-quobyte-a40be28d-67bc-48d2-b730-f5ddebb870c8" acquired by "delete_volume" :: waited 0.014s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:48:14 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c596f6-5520-4d1f-a7bf-bf3fb0df9e33]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:48:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ee2afb8d-af42-4e6f-a2cb-ed1b7467e3ef tempest-TestStampPattern-209527487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a40be28d-67bc-48d2-b730-f5ddebb870c8 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:14 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a40be28d-67bc-48d2-b730-f5ddebb870c8 Jun 04 06:48:14 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:15 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ee2afb8d-af42-4e6f-a2cb-ed1b7467e3ef tempest-TestStampPattern-209527487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a40be28d-67bc-48d2-b730-f5ddebb870c8" returned: 0 in 0.714s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ee2afb8d-af42-4e6f-a2cb-ed1b7467e3ef tempest-TestStampPattern-209527487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a40be28d-67bc-48d2-b730-f5ddebb870c8 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:15 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a40be28d-67bc-48d2-b730-f5ddebb870c8 Jun 04 06:48:15 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:15 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:15 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ee2afb8d-af42-4e6f-a2cb-ed1b7467e3ef tempest-TestStampPattern-209527487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-a40be28d-67bc-48d2-b730-f5ddebb870c8" returned: 0 in 0.559s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:15 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ee2afb8d-af42-4e6f-a2cb-ed1b7467e3ef tempest-TestStampPattern-209527487 None] Lock "cinder-quobyte-a40be28d-67bc-48d2-b730-f5ddebb870c8" released by "delete_volume" :: held 1.310s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:48:15 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-ee2afb8d-af42-4e6f-a2cb-ed1b7467e3ef tempest-TestStampPattern-209527487 None] Created reservations ['b4a29b98-4e38-436c-818c-bb8f856db874', '7c55ce75-3e74-4c67-a066-43f9ebc84712', 'e0bf37c7-0dde-436c-a290-5f395d26c8f2', '8031fabf-5d39-43a0-9b7a-ed64dd0b2934'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:48:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ee2afb8d-af42-4e6f-a2cb-ed1b7467e3ef tempest-TestStampPattern-209527487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:48:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ee2afb8d-af42-4e6f-a2cb-ed1b7467e3ef tempest-TestStampPattern-209527487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:48:16 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ee2afb8d-af42-4e6f-a2cb-ed1b7467e3ef tempest-TestStampPattern-209527487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:48:16 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ee2afb8d-af42-4e6f-a2cb-ed1b7467e3ef tempest-TestStampPattern-209527487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:48:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ee2afb8d-af42-4e6f-a2cb-ed1b7467e3ef tempest-TestStampPattern-209527487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:48:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ee2afb8d-af42-4e6f-a2cb-ed1b7467e3ef tempest-TestStampPattern-209527487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:16 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:48:16 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:16 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ee2afb8d-af42-4e6f-a2cb-ed1b7467e3ef tempest-TestStampPattern-209527487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.557s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:16 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-ee2afb8d-af42-4e6f-a2cb-ed1b7467e3ef tempest-TestStampPattern-209527487 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:48:16 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-ee2afb8d-af42-4e6f-a2cb-ed1b7467e3ef tempest-TestStampPattern-209527487 None] Deleted volume successfully. Jun 04 06:48:16 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ee2afb8d-af42-4e6f-a2cb-ed1b7467e3ef tempest-TestStampPattern-209527487 None] Lock "cinder-a40be28d-67bc-48d2-b730-f5ddebb870c8-delete_volume" released by "delete_volume" :: held 2.046s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:48:17 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-dbcbb86a-3a22-498a-8a04-165619b08271 tempest-TestStampPattern-209527487 None] Acquiring lock "cinder-fc170624-f437-41a7-b36f-a763dd514a85-delete_snapshot" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:48:17 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-dbcbb86a-3a22-498a-8a04-165619b08271 tempest-TestStampPattern-209527487 None] Lock "cinder-fc170624-f437-41a7-b36f-a763dd514a85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:48:17 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-dbcbb86a-3a22-498a-8a04-165619b08271 tempest-TestStampPattern-209527487 None] Acquiring lock "cinder-quobyte-e7a767e8-5ee4-49df-a6e6-1e7d77929a35" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:48:17 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-dbcbb86a-3a22-498a-8a04-165619b08271 tempest-TestStampPattern-209527487 None] Lock "cinder-quobyte-e7a767e8-5ee4-49df-a6e6-1e7d77929a35" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:48:17 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-dbcbb86a-3a22-498a-8a04-165619b08271 tempest-TestStampPattern-209527487 None] Acquiring lock "cinder-quobyte-fc170624-f437-41a7-b36f-a763dd514a85" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:48:17 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-dbcbb86a-3a22-498a-8a04-165619b08271 tempest-TestStampPattern-209527487 None] Lock "cinder-quobyte-fc170624-f437-41a7-b36f-a763dd514a85" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:48:17 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-dbcbb86a-3a22-498a-8a04-165619b08271 tempest-TestStampPattern-209527487 None] Deleting offline snapshot fc170624-f437-41a7-b36f-a763dd514a85 of volume e7a767e8-5ee4-49df-a6e6-1e7d77929a35 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:48:17 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-dbcbb86a-3a22-498a-8a04-165619b08271 tempest-TestStampPattern-209527487 None] snapshot_file for this snap is: volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35.fc170624-f437-41a7-b36f-a763dd514a85 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:48:17 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9c8cc2-8a25-4891-ab8b-8e44e510806c]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:48:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dbcbb86a-3a22-498a-8a04-165619b08271 tempest-TestStampPattern-209527487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35.fc170624-f437-41a7-b36f-a763dd514a85 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:17 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35.fc170624-f437-41a7-b36f-a763dd514a85 Jun 04 06:48:17 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:17 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dbcbb86a-3a22-498a-8a04-165619b08271 tempest-TestStampPattern-209527487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35.fc170624-f437-41a7-b36f-a763dd514a85" returned: 0 in 0.673s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:17 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-dbcbb86a-3a22-498a-8a04-165619b08271 tempest-TestStampPattern-209527487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:48:17 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[db67f32e-456c-4469-98ac-67c6cfd63580]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:48:17 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dbcbb86a-3a22-498a-8a04-165619b08271 tempest-TestStampPattern-209527487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:17 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35 Jun 04 06:48:17 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:18 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dbcbb86a-3a22-498a-8a04-165619b08271 tempest-TestStampPattern-209527487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35" returned: 0 in 0.669s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dbcbb86a-3a22-498a-8a04-165619b08271 tempest-TestStampPattern-209527487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35.fc170624-f437-41a7-b36f-a763dd514a85 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:18 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35.fc170624-f437-41a7-b36f-a763dd514a85 Jun 04 06:48:18 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:19 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dbcbb86a-3a22-498a-8a04-165619b08271 tempest-TestStampPattern-209527487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35.fc170624-f437-41a7-b36f-a763dd514a85" returned: 0 in 0.755s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dbcbb86a-3a22-498a-8a04-165619b08271 tempest-TestStampPattern-209527487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35.fc170624-f437-41a7-b36f-a763dd514a85 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:19 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35.fc170624-f437-41a7-b36f-a763dd514a85 Jun 04 06:48:19 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:19 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dbcbb86a-3a22-498a-8a04-165619b08271 tempest-TestStampPattern-209527487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35.fc170624-f437-41a7-b36f-a763dd514a85" returned: 0 in 0.558s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:19 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-dbcbb86a-3a22-498a-8a04-165619b08271 tempest-TestStampPattern-209527487 None] Lock "cinder-quobyte-fc170624-f437-41a7-b36f-a763dd514a85" released by "_delete_snapshot" :: held 2.751s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:48:19 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-dbcbb86a-3a22-498a-8a04-165619b08271 tempest-TestStampPattern-209527487 None] Lock "cinder-quobyte-e7a767e8-5ee4-49df-a6e6-1e7d77929a35" released by "delete_snapshot" :: held 2.773s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:48:19 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-dbcbb86a-3a22-498a-8a04-165619b08271 tempest-TestStampPattern-209527487 None] Created reservations ['cd713dc8-f389-4c66-9c42-2cd1d058e757', '8335247e-923e-4cff-8363-a45ffbb876b1', '3bed8911-23f8-4e78-a83b-e1965a1c07db', 'ea281ada-9b4e-4829-b86a-e165bfdd78bf'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:48:19 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-dbcbb86a-3a22-498a-8a04-165619b08271 tempest-TestStampPattern-209527487 None] Delete snapshot completed successfully. Jun 04 06:48:19 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-dbcbb86a-3a22-498a-8a04-165619b08271 tempest-TestStampPattern-209527487 None] Lock "cinder-fc170624-f437-41a7-b36f-a763dd514a85-delete_snapshot" released by "delete_snapshot" :: held 2.901s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:48:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-21e5072f-3461-4983-8668-2b21ecd4963d tempest-TestStampPattern-209527487 None] Acquiring lock "cinder-e7a767e8-5ee4-49df-a6e6-1e7d77929a35-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:48:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-21e5072f-3461-4983-8668-2b21ecd4963d tempest-TestStampPattern-209527487 None] Lock "cinder-e7a767e8-5ee4-49df-a6e6-1e7d77929a35-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:48:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-21e5072f-3461-4983-8668-2b21ecd4963d tempest-TestStampPattern-209527487 None] Acquiring lock "cinder-quobyte-e7a767e8-5ee4-49df-a6e6-1e7d77929a35" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:48:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-21e5072f-3461-4983-8668-2b21ecd4963d tempest-TestStampPattern-209527487 None] Lock "cinder-quobyte-e7a767e8-5ee4-49df-a6e6-1e7d77929a35" acquired by "delete_volume" :: waited 0.014s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:48:27 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cdb3cf-ad4c-47c2-a1bf-f785c30b523d]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:48:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-21e5072f-3461-4983-8668-2b21ecd4963d tempest-TestStampPattern-209527487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:27 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35 Jun 04 06:48:27 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:27 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-21e5072f-3461-4983-8668-2b21ecd4963d tempest-TestStampPattern-209527487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35" returned: 0 in 0.696s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-21e5072f-3461-4983-8668-2b21ecd4963d tempest-TestStampPattern-209527487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:27 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35 Jun 04 06:48:27 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:28 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-21e5072f-3461-4983-8668-2b21ecd4963d tempest-TestStampPattern-209527487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e7a767e8-5ee4-49df-a6e6-1e7d77929a35" returned: 0 in 0.590s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:28 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-21e5072f-3461-4983-8668-2b21ecd4963d tempest-TestStampPattern-209527487 None] Lock "cinder-quobyte-e7a767e8-5ee4-49df-a6e6-1e7d77929a35" released by "delete_volume" :: held 1.342s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:48:28 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-21e5072f-3461-4983-8668-2b21ecd4963d tempest-TestStampPattern-209527487 None] Created reservations ['b276be15-c1a3-4315-b2c6-abb780d8ede0', '1c53f09f-4823-4f5d-a249-704a725923bd', '67f9587a-4cb2-4787-b96c-369f6154e35f', '866211d6-622a-416d-bd1c-a559c39749ab'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:48:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-21e5072f-3461-4983-8668-2b21ecd4963d tempest-TestStampPattern-209527487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:48:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-21e5072f-3461-4983-8668-2b21ecd4963d tempest-TestStampPattern-209527487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:48:28 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-21e5072f-3461-4983-8668-2b21ecd4963d tempest-TestStampPattern-209527487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:48:28 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-21e5072f-3461-4983-8668-2b21ecd4963d tempest-TestStampPattern-209527487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:48:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-21e5072f-3461-4983-8668-2b21ecd4963d tempest-TestStampPattern-209527487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:48:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-21e5072f-3461-4983-8668-2b21ecd4963d tempest-TestStampPattern-209527487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:28 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:48:28 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:29 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-21e5072f-3461-4983-8668-2b21ecd4963d tempest-TestStampPattern-209527487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.593s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:29 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-21e5072f-3461-4983-8668-2b21ecd4963d tempest-TestStampPattern-209527487 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:48:29 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-21e5072f-3461-4983-8668-2b21ecd4963d tempest-TestStampPattern-209527487 None] Deleted volume successfully. Jun 04 06:48:29 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-21e5072f-3461-4983-8668-2b21ecd4963d tempest-TestStampPattern-209527487 None] Lock "cinder-e7a767e8-5ee4-49df-a6e6-1e7d77929a35-delete_volume" released by "delete_volume" :: held 2.112s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:48:38 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=24,cinder:UPDATE=27,cinder:INSERT=6 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:48:38 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:48:38 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] Flow 'volume_create_manager' (05d14b9e-b830-436c-8837-fb228f892ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:48:38 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baeeddad-8d57-4b37-9772-fd3e68d7d4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:38 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baeeddad-8d57-4b37-9772-fd3e68d7d4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1193260687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ecac708-f3ae-4fef-ac5c-2b884d24ba63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afba8dd01053440ab139d55f9085eb31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:48:39Z,use_quota=True,user_id='7bc1a4229c63415fb7f21f3b1f65ab7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:38 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c35f956e-37cf-4dbb-aaeb-529dc624cc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:38 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c35f956e-37cf-4dbb-aaeb-529dc624cc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:38 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f10c24-baf5-433c-85ef-448069738d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:38 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f10c24-baf5-433c-85ef-448069738d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ecac708-f3ae-4fef-ac5c-2b884d24ba63', 'volume_name': 'volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:38 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f966fc9e-34bb-43c0-8480-56e9ea4dad4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:38 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f966fc9e-34bb-43c0-8480-56e9ea4dad4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:38 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f256f50-30fd-464a-8dad-49fb1ce6fa23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:38 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] Volume 2ecac708-f3ae-4fef-ac5c-2b884d24ba63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63', 'volume_size': 1} Jun 04 06:48:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:48:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:48:38 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1193260687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ecac708-f3ae-4fef-ac5c-2b884d24ba63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afba8dd01053440ab139d55f9085eb31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:48:39Z,use_quota=True,user_id='7bc1a4229c63415fb7f21f3b1f65ab7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:48:38 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] Creating volume 2ecac708-f3ae-4fef-ac5c-2b884d24ba63 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:48:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:48:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:48:38 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:48:38 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:48:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:48:38 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:48:38 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:48:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:38 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63 1073741824 Jun 04 06:48:38 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:39 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63 1073741824" returned: 0 in 0.769s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:39 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63 Jun 04 06:48:39 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:40 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63" returned: 0 in 0.591s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:40 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:48:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.406s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:48:40 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f256f50-30fd-464a-8dad-49fb1ce6fa23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:40 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd3dcafc-47a5-446d-a7a7-ce8ec61ce210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:40 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] Volume volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63 (2ecac708-f3ae-4fef-ac5c-2b884d24ba63): created successfully Jun 04 06:48:40 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd3dcafc-47a5-446d-a7a7-ce8ec61ce210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:40 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] Flow 'volume_create_manager' (05d14b9e-b830-436c-8837-fb228f892ffc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:48:40 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-11b6fbad-7ac3-40df-a4a2-d850202da264 tempest-CreateVolumesFromSnapshotTest-248592863 None] Created volume successfully. Jun 04 06:48:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a56c24b9-dac8-440b-ba78-5e033fb5f63c tempest-CreateVolumesFromSnapshotTest-248592863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:48:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a56c24b9-dac8-440b-ba78-5e033fb5f63c tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:48:41 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-a56c24b9-dac8-440b-ba78-5e033fb5f63c tempest-CreateVolumesFromSnapshotTest-248592863 None] Creating offline snapshot 43252fc2-bd40-486e-a130-a088de97bbaf of volume 2ecac708-f3ae-4fef-ac5c-2b884d24ba63 {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:48:41 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32d220b-0388-47da-8353-fb805b10a7c3]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:48:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a56c24b9-dac8-440b-ba78-5e033fb5f63c tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:41 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63 Jun 04 06:48:41 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:41 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a56c24b9-dac8-440b-ba78-5e033fb5f63c tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63" returned: 0 in 0.712s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a56c24b9-dac8-440b-ba78-5e033fb5f63c tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63.43252fc2-bd40-486e-a130-a088de97bbaf 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:41 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63.43252fc2-bd40-486e-a130-a088de97bbaf 1G Jun 04 06:48:41 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:42 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a56c24b9-dac8-440b-ba78-5e033fb5f63c tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63.43252fc2-bd40-486e-a130-a088de97bbaf 1G" returned: 0 in 0.734s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a56c24b9-dac8-440b-ba78-5e033fb5f63c tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63.43252fc2-bd40-486e-a130-a088de97bbaf {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:42 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63.43252fc2-bd40-486e-a130-a088de97bbaf Jun 04 06:48:42 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:43 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a56c24b9-dac8-440b-ba78-5e033fb5f63c tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63.43252fc2-bd40-486e-a130-a088de97bbaf" returned: 0 in 0.623s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:43 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-a56c24b9-dac8-440b-ba78-5e033fb5f63c tempest-CreateVolumesFromSnapshotTest-248592863 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63.43252fc2-bd40-486e-a130-a088de97bbaf is being set with open permissions: ugo+rw Jun 04 06:48:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a56c24b9-dac8-440b-ba78-5e033fb5f63c tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63.43252fc2-bd40-486e-a130-a088de97bbaf {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:43 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63.43252fc2-bd40-486e-a130-a088de97bbaf Jun 04 06:48:43 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:43 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a56c24b9-dac8-440b-ba78-5e033fb5f63c tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63.43252fc2-bd40-486e-a130-a088de97bbaf" returned: 0 in 0.593s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a56c24b9-dac8-440b-ba78-5e033fb5f63c tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:43 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63.info Jun 04 06:48:43 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:44 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a56c24b9-dac8-440b-ba78-5e033fb5f63c tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63.info" returned: 0 in 0.612s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:44 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-a56c24b9-dac8-440b-ba78-5e033fb5f63c tempest-CreateVolumesFromSnapshotTest-248592863 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63.info is being set with open permissions: ugo+rw Jun 04 06:48:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a56c24b9-dac8-440b-ba78-5e033fb5f63c tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:44 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63.info Jun 04 06:48:44 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:45 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a56c24b9-dac8-440b-ba78-5e033fb5f63c tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63.info" returned: 0 in 0.594s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a56c24b9-dac8-440b-ba78-5e033fb5f63c tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.956s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:48:45 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-a56c24b9-dac8-440b-ba78-5e033fb5f63c tempest-CreateVolumesFromSnapshotTest-248592863 None] Create snapshot completed successfully Jun 04 06:48:46 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:48:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] Flow 'volume_create_manager' (504661cd-ee9e-45d8-899a-40eb37fa60af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:48:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d63fd52f-5317-4151-ad28-9a3d7d99795c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d63fd52f-5317-4151-ad28-9a3d7d99795c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-78644452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f2d4974-1a06-40cf-8f8d-f1f86202f0b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afba8dd01053440ab139d55f9085eb31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:48:47Z,use_quota=True,user_id='7bc1a4229c63415fb7f21f3b1f65ab7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79a8b295-d072-4321-aaf1-ff6a07f206aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79a8b295-d072-4321-aaf1-ff6a07f206aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9efb0b04-e760-481e-84e1-ea70058cb5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9efb0b04-e760-481e-84e1-ea70058cb5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f2d4974-1a06-40cf-8f8d-f1f86202f0b1', 'volume_name': 'volume-4f2d4974-1a06-40cf-8f8d-f1f86202f0b1', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea09469-ff54-4244-a361-b675e59adffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea09469-ff54-4244-a361-b675e59adffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0a9f86-e37a-47ad-b11f-0fc57bfefd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:46 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] Volume 4f2d4974-1a06-40cf-8f8d-f1f86202f0b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f2d4974-1a06-40cf-8f8d-f1f86202f0b1', 'volume_size': 1} Jun 04 06:48:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:48:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:48:46 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-78644452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f2d4974-1a06-40cf-8f8d-f1f86202f0b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afba8dd01053440ab139d55f9085eb31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:48:47Z,use_quota=True,user_id='7bc1a4229c63415fb7f21f3b1f65ab7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:48:46 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] Creating volume 4f2d4974-1a06-40cf-8f8d-f1f86202f0b1 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:48:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:48:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:48:46 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:48:46 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:48:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:48:46 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:48:46 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:48:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4f2d4974-1a06-40cf-8f8d-f1f86202f0b1 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:46 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4f2d4974-1a06-40cf-8f8d-f1f86202f0b1 1073741824 Jun 04 06:48:46 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:46 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:48:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] Flow 'volume_create_manager' (a73b711f-7dee-4a2c-b3d8-6590cb1e8481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:48:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac5f0488-2b1a-4a6f-b09c-eecafbfc4d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac5f0488-2b1a-4a6f-b09c-eecafbfc4d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:48:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-937780441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f90a2433-431f-4064-8902-82893edd2066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afba8dd01053440ab139d55f9085eb31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:48:47Z,use_quota=True,user_id='7bc1a4229c63415fb7f21f3b1f65ab7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14cee769-a1fe-4f0d-b3c6-3e8420c7cbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14cee769-a1fe-4f0d-b3c6-3e8420c7cbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df50fcf-ac7e-4dc1-8137-22ac95ee62c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df50fcf-ac7e-4dc1-8137-22ac95ee62c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f90a2433-431f-4064-8902-82893edd2066', 'volume_name': 'volume-f90a2433-431f-4064-8902-82893edd2066', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91515dc6-856c-46f3-a352-551f807e6191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91515dc6-856c-46f3-a352-551f807e6191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:46 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (936fd725-58e8-4f4d-b09e-b7430dbf065f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:46 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] Volume f90a2433-431f-4064-8902-82893edd2066: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f90a2433-431f-4064-8902-82893edd2066', 'volume_size': 1} Jun 04 06:48:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:48:47 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:48:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Flow 'volume_create_manager' (1e1b4b4c-7d63-4a8c-8ce8-79c91685f995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:48:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4228b67-1d65-4308-9394-f9c3d616450b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4228b67-1d65-4308-9394-f9c3d616450b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:48:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1988819121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=867018dc-2fdc-41b4-915a-3791659d863e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afba8dd01053440ab139d55f9085eb31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:48:47Z,use_quota=True,user_id='7bc1a4229c63415fb7f21f3b1f65ab7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b11726-b498-4b41-80ef-a545d674256b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b11726-b498-4b41-80ef-a545d674256b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6df8ac7-37c7-4315-a5fb-8c477a78917d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6df8ac7-37c7-4315-a5fb-8c477a78917d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '867018dc-2fdc-41b4-915a-3791659d863e', 'volume_name': 'volume-867018dc-2fdc-41b4-915a-3791659d863e', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95f11adb-8c1a-4ee9-8440-3b71a3bf5e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95f11adb-8c1a-4ee9-8440-3b71a3bf5e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e475de-5376-4e6e-b452-abafd9369551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:47 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Volume 867018dc-2fdc-41b4-915a-3791659d863e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-867018dc-2fdc-41b4-915a-3791659d863e', 'volume_size': 1} Jun 04 06:48:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:48:47 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4f2d4974-1a06-40cf-8f8d-f1f86202f0b1 1073741824" returned: 0 in 0.821s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4f2d4974-1a06-40cf-8f8d-f1f86202f0b1 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:47 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4f2d4974-1a06-40cf-8f8d-f1f86202f0b1 Jun 04 06:48:47 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:47 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:48:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Flow 'volume_create_manager' (6a384395-65cd-4c0f-84ff-4d6ef67b058c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:48:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (758dc8c6-1906-4c6c-8b18-5f9ee17fb7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (758dc8c6-1906-4c6c-8b18-5f9ee17fb7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:48:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1012874411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8dd8116-8552-4cd1-86f3-2b5c8ce2faf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afba8dd01053440ab139d55f9085eb31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:48:48Z,use_quota=True,user_id='7bc1a4229c63415fb7f21f3b1f65ab7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aefb4b49-2390-4e6b-912a-a142a1a61ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aefb4b49-2390-4e6b-912a-a142a1a61ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daac3065-6276-4e29-82a5-3b7bfa083a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daac3065-6276-4e29-82a5-3b7bfa083a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8dd8116-8552-4cd1-86f3-2b5c8ce2faf1', 'volume_name': 'volume-f8dd8116-8552-4cd1-86f3-2b5c8ce2faf1', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f69e875-50cf-462f-8b22-83a977bd4adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f69e875-50cf-462f-8b22-83a977bd4adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05c3ea8a-9ba4-4c86-9f43-1c5fa3bd6f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:47 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Volume f8dd8116-8552-4cd1-86f3-2b5c8ce2faf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8dd8116-8552-4cd1-86f3-2b5c8ce2faf1', 'volume_size': 1} Jun 04 06:48:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:48:47 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:48:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Flow 'volume_create_manager' (2241b27b-62e8-459a-b728-c7187da70954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:48:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (170adf73-cfbc-4cf4-9aad-80d59930ff2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (170adf73-cfbc-4cf4-9aad-80d59930ff2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-264755714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=995294f3-0d32-4263-89eb-49c2e95dc925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afba8dd01053440ab139d55f9085eb31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:48:48Z,use_quota=True,user_id='7bc1a4229c63415fb7f21f3b1f65ab7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b50c2319-51f1-4571-b7e2-07c9cee3bd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b50c2319-51f1-4571-b7e2-07c9cee3bd87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e40380df-e1be-446b-bfcf-f09ebf706e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e40380df-e1be-446b-bfcf-f09ebf706e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '995294f3-0d32-4263-89eb-49c2e95dc925', 'volume_name': 'volume-995294f3-0d32-4263-89eb-49c2e95dc925', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:48 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (672b300f-a15a-4b67-ba35-de4e4003d450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:48 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (672b300f-a15a-4b67-ba35-de4e4003d450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:48 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6391b5e-96fb-429a-8eed-797ad71fa239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:48 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Volume 995294f3-0d32-4263-89eb-49c2e95dc925: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-995294f3-0d32-4263-89eb-49c2e95dc925', 'volume_size': 1} Jun 04 06:48:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:48:48 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4f2d4974-1a06-40cf-8f8d-f1f86202f0b1" returned: 0 in 0.619s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:48 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:48:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:48:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.201s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:48:48 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:48:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-937780441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f90a2433-431f-4064-8902-82893edd2066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afba8dd01053440ab139d55f9085eb31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:48:47Z,use_quota=True,user_id='7bc1a4229c63415fb7f21f3b1f65ab7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:48:48 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] Creating volume f90a2433-431f-4064-8902-82893edd2066 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:48:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:48:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:48:48 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:48:48 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:48:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:48:48 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:48:48 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:48:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f90a2433-431f-4064-8902-82893edd2066 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:48 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0a9f86-e37a-47ad-b11f-0fc57bfefd3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f2d4974-1a06-40cf-8f8d-f1f86202f0b1', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:48 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f90a2433-431f-4064-8902-82893edd2066 1073741824 Jun 04 06:48:48 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:48 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d88259b3-af14-4e8b-8ec9-295d1e40be54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:48 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] Volume volume-4f2d4974-1a06-40cf-8f8d-f1f86202f0b1 (4f2d4974-1a06-40cf-8f8d-f1f86202f0b1): created successfully Jun 04 06:48:48 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d88259b3-af14-4e8b-8ec9-295d1e40be54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:48 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] Flow 'volume_create_manager' (504661cd-ee9e-45d8-899a-40eb37fa60af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:48:48 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-9732d0a6-7882-4f08-aa00-ea6b77c51ae0 tempest-CreateVolumesFromSnapshotTest-248592863 None] Created volume successfully. Jun 04 06:48:48 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f90a2433-431f-4064-8902-82893edd2066 1073741824" returned: 0 in 0.728s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f90a2433-431f-4064-8902-82893edd2066 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:48 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f90a2433-431f-4064-8902-82893edd2066 Jun 04 06:48:48 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:49 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f90a2433-431f-4064-8902-82893edd2066" returned: 0 in 0.612s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:49 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:48:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:48:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.215s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:48:49 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:48:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1988819121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=867018dc-2fdc-41b4-915a-3791659d863e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afba8dd01053440ab139d55f9085eb31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:48:47Z,use_quota=True,user_id='7bc1a4229c63415fb7f21f3b1f65ab7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:48:49 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Creating volume 867018dc-2fdc-41b4-915a-3791659d863e {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:48:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:48:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:48:49 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:48:49 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:48:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:48:49 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:48:49 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:48:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-867018dc-2fdc-41b4-915a-3791659d863e 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:49 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-867018dc-2fdc-41b4-915a-3791659d863e 1073741824 Jun 04 06:48:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (936fd725-58e8-4f4d-b09e-b7430dbf065f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f90a2433-431f-4064-8902-82893edd2066', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:49 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77344d98-81e6-4595-a1fb-0b4529d7c171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:49 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] Volume volume-f90a2433-431f-4064-8902-82893edd2066 (f90a2433-431f-4064-8902-82893edd2066): created successfully Jun 04 06:48:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77344d98-81e6-4595-a1fb-0b4529d7c171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:49 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] Flow 'volume_create_manager' (a73b711f-7dee-4a2c-b3d8-6590cb1e8481) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:48:49 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-dd72aa45-929e-4c7b-be0e-c0b05f87af32 tempest-CreateVolumesFromSnapshotTest-248592863 None] Created volume successfully. Jun 04 06:48:50 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-867018dc-2fdc-41b4-915a-3791659d863e 1073741824" returned: 0 in 0.756s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-867018dc-2fdc-41b4-915a-3791659d863e {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:50 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-867018dc-2fdc-41b4-915a-3791659d863e Jun 04 06:48:50 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:50 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-867018dc-2fdc-41b4-915a-3791659d863e" returned: 0 in 0.559s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:50 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:48:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:48:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.202s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:48:50 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:48:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1012874411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8dd8116-8552-4cd1-86f3-2b5c8ce2faf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afba8dd01053440ab139d55f9085eb31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:48:48Z,use_quota=True,user_id='7bc1a4229c63415fb7f21f3b1f65ab7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:48:50 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Creating volume f8dd8116-8552-4cd1-86f3-2b5c8ce2faf1 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:48:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:48:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:48:50 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:48:50 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:48:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:48:50 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:48:50 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:48:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f8dd8116-8552-4cd1-86f3-2b5c8ce2faf1 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:50 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f8dd8116-8552-4cd1-86f3-2b5c8ce2faf1 1073741824 Jun 04 06:48:50 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e475de-5376-4e6e-b452-abafd9369551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-867018dc-2fdc-41b4-915a-3791659d863e', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (618c06b6-5583-4232-bbe8-296e8c3f9200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:50 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Volume volume-867018dc-2fdc-41b4-915a-3791659d863e (867018dc-2fdc-41b4-915a-3791659d863e): created successfully Jun 04 06:48:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (618c06b6-5583-4232-bbe8-296e8c3f9200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Flow 'volume_create_manager' (1e1b4b4c-7d63-4a8c-8ce8-79c91685f995) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:48:50 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-67604d00-3944-44e9-b4b5-9c2907aa93d8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Created volume successfully. Jun 04 06:48:51 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f8dd8116-8552-4cd1-86f3-2b5c8ce2faf1 1073741824" returned: 0 in 0.744s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f8dd8116-8552-4cd1-86f3-2b5c8ce2faf1 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:51 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f8dd8116-8552-4cd1-86f3-2b5c8ce2faf1 Jun 04 06:48:51 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:52 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f8dd8116-8552-4cd1-86f3-2b5c8ce2faf1" returned: 0 in 0.571s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:52 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:48:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:48:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.244s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:48:52 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-264755714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=995294f3-0d32-4263-89eb-49c2e95dc925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afba8dd01053440ab139d55f9085eb31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:48:48Z,use_quota=True,user_id='7bc1a4229c63415fb7f21f3b1f65ab7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:48:52 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Creating volume 995294f3-0d32-4263-89eb-49c2e95dc925 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:48:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:48:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:48:52 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:48:52 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:48:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:48:52 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:48:52 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:48:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-995294f3-0d32-4263-89eb-49c2e95dc925 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:52 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05c3ea8a-9ba4-4c86-9f43-1c5fa3bd6f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8dd8116-8552-4cd1-86f3-2b5c8ce2faf1', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:52 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-995294f3-0d32-4263-89eb-49c2e95dc925 1073741824 Jun 04 06:48:52 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:52 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179ae5c8-8b0b-4038-8d41-e4921e2b558e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:52 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Volume volume-f8dd8116-8552-4cd1-86f3-2b5c8ce2faf1 (f8dd8116-8552-4cd1-86f3-2b5c8ce2faf1): created successfully Jun 04 06:48:52 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179ae5c8-8b0b-4038-8d41-e4921e2b558e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:52 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Flow 'volume_create_manager' (6a384395-65cd-4c0f-84ff-4d6ef67b058c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:48:52 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-fee11927-4534-4dd7-94a2-6c9ea943bfa8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Created volume successfully. Jun 04 06:48:53 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-995294f3-0d32-4263-89eb-49c2e95dc925 1073741824" returned: 0 in 0.736s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-995294f3-0d32-4263-89eb-49c2e95dc925 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:53 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-995294f3-0d32-4263-89eb-49c2e95dc925 Jun 04 06:48:53 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:53 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-995294f3-0d32-4263-89eb-49c2e95dc925" returned: 0 in 0.557s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:53 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:48:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.334s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:48:53 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6391b5e-96fb-429a-8eed-797ad71fa239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-995294f3-0d32-4263-89eb-49c2e95dc925', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:53 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43d067ec-e8a3-4508-94ff-f751773df2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:48:53 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Volume volume-995294f3-0d32-4263-89eb-49c2e95dc925 (995294f3-0d32-4263-89eb-49c2e95dc925): created successfully Jun 04 06:48:53 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43d067ec-e8a3-4508-94ff-f751773df2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:48:53 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Flow 'volume_create_manager' (2241b27b-62e8-459a-b728-c7187da70954) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:48:53 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-cfa62d6e-8285-495e-9654-a95290f0dac8 tempest-CreateVolumesFromSnapshotTest-248592863 None] Created volume successfully. Jun 04 06:48:54 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7217b3f8-9a2e-4d42-a19f-23384764c682 tempest-CreateVolumesFromSnapshotTest-248592863 None] Acquiring lock "cinder-995294f3-0d32-4263-89eb-49c2e95dc925-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:48:54 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7217b3f8-9a2e-4d42-a19f-23384764c682 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "cinder-995294f3-0d32-4263-89eb-49c2e95dc925-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:48:54 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=39,cinder:UPDATE=39,cinder:INSERT=9,cinder:DELETE=8 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:48:54 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7217b3f8-9a2e-4d42-a19f-23384764c682 tempest-CreateVolumesFromSnapshotTest-248592863 None] Acquiring lock "cinder-quobyte-995294f3-0d32-4263-89eb-49c2e95dc925" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:48:54 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7217b3f8-9a2e-4d42-a19f-23384764c682 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "cinder-quobyte-995294f3-0d32-4263-89eb-49c2e95dc925" acquired by "delete_volume" :: waited 0.016s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:48:54 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[64835abf-98b4-41c9-adb1-b846087a3939]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:48:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7217b3f8-9a2e-4d42-a19f-23384764c682 tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-995294f3-0d32-4263-89eb-49c2e95dc925 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:54 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-995294f3-0d32-4263-89eb-49c2e95dc925 Jun 04 06:48:54 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:55 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7217b3f8-9a2e-4d42-a19f-23384764c682 tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-995294f3-0d32-4263-89eb-49c2e95dc925" returned: 0 in 0.687s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7217b3f8-9a2e-4d42-a19f-23384764c682 tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-995294f3-0d32-4263-89eb-49c2e95dc925 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:55 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-995294f3-0d32-4263-89eb-49c2e95dc925 Jun 04 06:48:55 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:55 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7217b3f8-9a2e-4d42-a19f-23384764c682 tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-995294f3-0d32-4263-89eb-49c2e95dc925" returned: 0 in 0.560s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:55 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7217b3f8-9a2e-4d42-a19f-23384764c682 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "cinder-quobyte-995294f3-0d32-4263-89eb-49c2e95dc925" released by "delete_volume" :: held 1.284s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:48:55 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-7217b3f8-9a2e-4d42-a19f-23384764c682 tempest-CreateVolumesFromSnapshotTest-248592863 None] Created reservations ['adea4466-9c5d-4c49-81f8-5ccabc4e5329', 'eb3a73b7-1f06-4907-8a42-eeb80f47a9ce', 'fabdbaf6-9aed-44aa-98d7-573db8a6ad7c', '039b5e51-5cee-494d-8092-b20452d6aa93'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:48:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7217b3f8-9a2e-4d42-a19f-23384764c682 tempest-CreateVolumesFromSnapshotTest-248592863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:48:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7217b3f8-9a2e-4d42-a19f-23384764c682 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:48:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7217b3f8-9a2e-4d42-a19f-23384764c682 tempest-CreateVolumesFromSnapshotTest-248592863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:48:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7217b3f8-9a2e-4d42-a19f-23384764c682 tempest-CreateVolumesFromSnapshotTest-248592863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:48:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7217b3f8-9a2e-4d42-a19f-23384764c682 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:48:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7217b3f8-9a2e-4d42-a19f-23384764c682 tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:55 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:48:55 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:56 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7217b3f8-9a2e-4d42-a19f-23384764c682 tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.549s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:56 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-7217b3f8-9a2e-4d42-a19f-23384764c682 tempest-CreateVolumesFromSnapshotTest-248592863 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:48:56 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-7217b3f8-9a2e-4d42-a19f-23384764c682 tempest-CreateVolumesFromSnapshotTest-248592863 None] Deleted volume successfully. Jun 04 06:48:56 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7217b3f8-9a2e-4d42-a19f-23384764c682 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "cinder-995294f3-0d32-4263-89eb-49c2e95dc925-delete_volume" released by "delete_volume" :: held 2.012s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:48:56 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-020fe0ab-9617-4e69-91d6-a477e5ef2f1e tempest-CreateVolumesFromSnapshotTest-248592863 None] Acquiring lock "cinder-f8dd8116-8552-4cd1-86f3-2b5c8ce2faf1-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:48:56 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-020fe0ab-9617-4e69-91d6-a477e5ef2f1e tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "cinder-f8dd8116-8552-4cd1-86f3-2b5c8ce2faf1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:48:56 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-020fe0ab-9617-4e69-91d6-a477e5ef2f1e tempest-CreateVolumesFromSnapshotTest-248592863 None] Acquiring lock "cinder-quobyte-f8dd8116-8552-4cd1-86f3-2b5c8ce2faf1" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:48:56 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-020fe0ab-9617-4e69-91d6-a477e5ef2f1e tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "cinder-quobyte-f8dd8116-8552-4cd1-86f3-2b5c8ce2faf1" acquired by "delete_volume" :: waited 0.013s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:48:56 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5eaf34-e30b-46c9-a8c8-f4167f0f8bd6]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:48:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-020fe0ab-9617-4e69-91d6-a477e5ef2f1e tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f8dd8116-8552-4cd1-86f3-2b5c8ce2faf1 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:56 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f8dd8116-8552-4cd1-86f3-2b5c8ce2faf1 Jun 04 06:48:56 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:57 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-020fe0ab-9617-4e69-91d6-a477e5ef2f1e tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f8dd8116-8552-4cd1-86f3-2b5c8ce2faf1" returned: 0 in 0.665s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-020fe0ab-9617-4e69-91d6-a477e5ef2f1e tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f8dd8116-8552-4cd1-86f3-2b5c8ce2faf1 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:57 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f8dd8116-8552-4cd1-86f3-2b5c8ce2faf1 Jun 04 06:48:57 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:58 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-020fe0ab-9617-4e69-91d6-a477e5ef2f1e tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f8dd8116-8552-4cd1-86f3-2b5c8ce2faf1" returned: 0 in 0.562s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:58 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-020fe0ab-9617-4e69-91d6-a477e5ef2f1e tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "cinder-quobyte-f8dd8116-8552-4cd1-86f3-2b5c8ce2faf1" released by "delete_volume" :: held 1.261s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:48:58 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-020fe0ab-9617-4e69-91d6-a477e5ef2f1e tempest-CreateVolumesFromSnapshotTest-248592863 None] Created reservations ['11dd861f-f39b-48de-adb5-e119e4ae9013', 'e9dde9b9-d945-4e35-9dc5-fc11a7db1a48', '0620e916-3bd8-4ac1-886e-ca26946aedf2', 'a9e835d8-c819-44c9-8da0-7d4f4144a2d8'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:48:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-020fe0ab-9617-4e69-91d6-a477e5ef2f1e tempest-CreateVolumesFromSnapshotTest-248592863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:48:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-020fe0ab-9617-4e69-91d6-a477e5ef2f1e tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:48:58 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-020fe0ab-9617-4e69-91d6-a477e5ef2f1e tempest-CreateVolumesFromSnapshotTest-248592863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:48:58 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-020fe0ab-9617-4e69-91d6-a477e5ef2f1e tempest-CreateVolumesFromSnapshotTest-248592863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:48:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-020fe0ab-9617-4e69-91d6-a477e5ef2f1e tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:48:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-020fe0ab-9617-4e69-91d6-a477e5ef2f1e tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:58 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:48:58 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:58 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-020fe0ab-9617-4e69-91d6-a477e5ef2f1e tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.554s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:58 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-020fe0ab-9617-4e69-91d6-a477e5ef2f1e tempest-CreateVolumesFromSnapshotTest-248592863 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:48:58 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-020fe0ab-9617-4e69-91d6-a477e5ef2f1e tempest-CreateVolumesFromSnapshotTest-248592863 None] Deleted volume successfully. Jun 04 06:48:58 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-020fe0ab-9617-4e69-91d6-a477e5ef2f1e tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "cinder-f8dd8116-8552-4cd1-86f3-2b5c8ce2faf1-delete_volume" released by "delete_volume" :: held 1.980s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:48:58 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-e4e5bf73-1dd9-4a7d-ab61-2fb418e82b9f tempest-CreateVolumesFromSnapshotTest-248592863 None] Acquiring lock "cinder-867018dc-2fdc-41b4-915a-3791659d863e-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:48:58 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-e4e5bf73-1dd9-4a7d-ab61-2fb418e82b9f tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "cinder-867018dc-2fdc-41b4-915a-3791659d863e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:48:58 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-e4e5bf73-1dd9-4a7d-ab61-2fb418e82b9f tempest-CreateVolumesFromSnapshotTest-248592863 None] Acquiring lock "cinder-quobyte-867018dc-2fdc-41b4-915a-3791659d863e" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:48:58 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-e4e5bf73-1dd9-4a7d-ab61-2fb418e82b9f tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "cinder-quobyte-867018dc-2fdc-41b4-915a-3791659d863e" acquired by "delete_volume" :: waited 0.013s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:48:58 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[94dfe63d-eaf7-4ab7-8576-9db55b31a974]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:48:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e4e5bf73-1dd9-4a7d-ab61-2fb418e82b9f tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-867018dc-2fdc-41b4-915a-3791659d863e {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:59 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-867018dc-2fdc-41b4-915a-3791659d863e Jun 04 06:48:59 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:48:59 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Jun 04 06:48:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e4e5bf73-1dd9-4a7d-ab61-2fb418e82b9f tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-867018dc-2fdc-41b4-915a-3791659d863e" returned: 0 in 0.664s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:48:59 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e4e5bf73-1dd9-4a7d-ab61-2fb418e82b9f tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-867018dc-2fdc-41b4-915a-3791659d863e {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:48:59 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-867018dc-2fdc-41b4-915a-3791659d863e Jun 04 06:48:59 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:00 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e4e5bf73-1dd9-4a7d-ab61-2fb418e82b9f tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-867018dc-2fdc-41b4-915a-3791659d863e" returned: 0 in 0.563s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:00 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-e4e5bf73-1dd9-4a7d-ab61-2fb418e82b9f tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "cinder-quobyte-867018dc-2fdc-41b4-915a-3791659d863e" released by "delete_volume" :: held 1.264s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:49:00 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-e4e5bf73-1dd9-4a7d-ab61-2fb418e82b9f tempest-CreateVolumesFromSnapshotTest-248592863 None] Created reservations ['fa6e6021-964c-4eb7-8e6f-0dfe7160884b', '4c4a08c9-38d3-4990-8ac6-0318bc912e23', '84f4f601-be90-434c-a847-84754da48853', '80ff9d52-5c1d-4af9-a6a0-7d8388309bd1'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:49:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e4e5bf73-1dd9-4a7d-ab61-2fb418e82b9f tempest-CreateVolumesFromSnapshotTest-248592863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e4e5bf73-1dd9-4a7d-ab61-2fb418e82b9f tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:00 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e4e5bf73-1dd9-4a7d-ab61-2fb418e82b9f tempest-CreateVolumesFromSnapshotTest-248592863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:49:00 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e4e5bf73-1dd9-4a7d-ab61-2fb418e82b9f tempest-CreateVolumesFromSnapshotTest-248592863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:49:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e4e5bf73-1dd9-4a7d-ab61-2fb418e82b9f tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e4e5bf73-1dd9-4a7d-ab61-2fb418e82b9f tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:00 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:49:00 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:00 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:00 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e4e5bf73-1dd9-4a7d-ab61-2fb418e82b9f tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.578s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:00 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-e4e5bf73-1dd9-4a7d-ab61-2fb418e82b9f tempest-CreateVolumesFromSnapshotTest-248592863 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:49:00 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-e4e5bf73-1dd9-4a7d-ab61-2fb418e82b9f tempest-CreateVolumesFromSnapshotTest-248592863 None] Deleted volume successfully. Jun 04 06:49:00 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-e4e5bf73-1dd9-4a7d-ab61-2fb418e82b9f tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "cinder-867018dc-2fdc-41b4-915a-3791659d863e-delete_volume" released by "delete_volume" :: held 2.013s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:49:01 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-3f3e2800-fb6b-4577-bc81-4baf0ac07b75 tempest-CreateVolumesFromSnapshotTest-248592863 None] Acquiring lock "cinder-f90a2433-431f-4064-8902-82893edd2066-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:01 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-3f3e2800-fb6b-4577-bc81-4baf0ac07b75 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "cinder-f90a2433-431f-4064-8902-82893edd2066-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:01 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-3f3e2800-fb6b-4577-bc81-4baf0ac07b75 tempest-CreateVolumesFromSnapshotTest-248592863 None] Acquiring lock "cinder-quobyte-f90a2433-431f-4064-8902-82893edd2066" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:01 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-3f3e2800-fb6b-4577-bc81-4baf0ac07b75 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "cinder-quobyte-f90a2433-431f-4064-8902-82893edd2066" acquired by "delete_volume" :: waited 0.016s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:01 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a417427-f476-4140-ace6-5084bf6eb721]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:49:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3f3e2800-fb6b-4577-bc81-4baf0ac07b75 tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f90a2433-431f-4064-8902-82893edd2066 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:01 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f90a2433-431f-4064-8902-82893edd2066 Jun 04 06:49:01 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:01 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3f3e2800-fb6b-4577-bc81-4baf0ac07b75 tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f90a2433-431f-4064-8902-82893edd2066" returned: 0 in 0.663s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:01 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3f3e2800-fb6b-4577-bc81-4baf0ac07b75 tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f90a2433-431f-4064-8902-82893edd2066 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:01 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f90a2433-431f-4064-8902-82893edd2066 Jun 04 06:49:01 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:02 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3f3e2800-fb6b-4577-bc81-4baf0ac07b75 tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f90a2433-431f-4064-8902-82893edd2066" returned: 0 in 0.568s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:02 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-3f3e2800-fb6b-4577-bc81-4baf0ac07b75 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "cinder-quobyte-f90a2433-431f-4064-8902-82893edd2066" released by "delete_volume" :: held 1.276s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:49:02 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-3f3e2800-fb6b-4577-bc81-4baf0ac07b75 tempest-CreateVolumesFromSnapshotTest-248592863 None] Created reservations ['3039820a-b9ad-4a2f-a23e-0ad0462134e8', '4c3e29c5-3b64-4046-95a7-49f1e5bd1f17', '9bc589df-561e-4734-a81f-e1941dc689ac', '22dc5ac2-3752-44db-bc82-42c29355fda5'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:49:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-3f3e2800-fb6b-4577-bc81-4baf0ac07b75 tempest-CreateVolumesFromSnapshotTest-248592863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-3f3e2800-fb6b-4577-bc81-4baf0ac07b75 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:02 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-3f3e2800-fb6b-4577-bc81-4baf0ac07b75 tempest-CreateVolumesFromSnapshotTest-248592863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:49:02 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-3f3e2800-fb6b-4577-bc81-4baf0ac07b75 tempest-CreateVolumesFromSnapshotTest-248592863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:49:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-3f3e2800-fb6b-4577-bc81-4baf0ac07b75 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:02 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3f3e2800-fb6b-4577-bc81-4baf0ac07b75 tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:02 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:49:02 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:03 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3f3e2800-fb6b-4577-bc81-4baf0ac07b75 tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.559s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:03 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-3f3e2800-fb6b-4577-bc81-4baf0ac07b75 tempest-CreateVolumesFromSnapshotTest-248592863 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:49:03 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-3f3e2800-fb6b-4577-bc81-4baf0ac07b75 tempest-CreateVolumesFromSnapshotTest-248592863 None] Deleted volume successfully. Jun 04 06:49:03 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-3f3e2800-fb6b-4577-bc81-4baf0ac07b75 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "cinder-f90a2433-431f-4064-8902-82893edd2066-delete_volume" released by "delete_volume" :: held 2.005s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:49:03 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7fe2171c-19d2-4450-8eda-ffd71aea0b72 tempest-CreateVolumesFromSnapshotTest-248592863 None] Acquiring lock "cinder-4f2d4974-1a06-40cf-8f8d-f1f86202f0b1-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:03 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7fe2171c-19d2-4450-8eda-ffd71aea0b72 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "cinder-4f2d4974-1a06-40cf-8f8d-f1f86202f0b1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:03 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7fe2171c-19d2-4450-8eda-ffd71aea0b72 tempest-CreateVolumesFromSnapshotTest-248592863 None] Acquiring lock "cinder-quobyte-4f2d4974-1a06-40cf-8f8d-f1f86202f0b1" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:03 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7fe2171c-19d2-4450-8eda-ffd71aea0b72 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "cinder-quobyte-4f2d4974-1a06-40cf-8f8d-f1f86202f0b1" acquired by "delete_volume" :: waited 0.016s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:03 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c670bc-7eb0-4406-a88d-4e3b4fa93df1]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:49:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7fe2171c-19d2-4450-8eda-ffd71aea0b72 tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4f2d4974-1a06-40cf-8f8d-f1f86202f0b1 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:03 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4f2d4974-1a06-40cf-8f8d-f1f86202f0b1 Jun 04 06:49:03 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:04 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7fe2171c-19d2-4450-8eda-ffd71aea0b72 tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4f2d4974-1a06-40cf-8f8d-f1f86202f0b1" returned: 0 in 0.665s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7fe2171c-19d2-4450-8eda-ffd71aea0b72 tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4f2d4974-1a06-40cf-8f8d-f1f86202f0b1 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:04 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4f2d4974-1a06-40cf-8f8d-f1f86202f0b1 Jun 04 06:49:04 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:04 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7fe2171c-19d2-4450-8eda-ffd71aea0b72 tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-4f2d4974-1a06-40cf-8f8d-f1f86202f0b1" returned: 0 in 0.555s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:04 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7fe2171c-19d2-4450-8eda-ffd71aea0b72 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "cinder-quobyte-4f2d4974-1a06-40cf-8f8d-f1f86202f0b1" released by "delete_volume" :: held 1.256s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:49:04 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-7fe2171c-19d2-4450-8eda-ffd71aea0b72 tempest-CreateVolumesFromSnapshotTest-248592863 None] Created reservations ['56d40169-c520-4bd2-a9da-21e4343a6a2b', '6592527a-f66f-4cbb-b3e6-79cbfe97da6b', '8e95ce19-96de-4f4d-a744-bfeaf9a5be2b', '86903151-652e-41d0-8ca6-a90ce6bbd61d'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:49:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7fe2171c-19d2-4450-8eda-ffd71aea0b72 tempest-CreateVolumesFromSnapshotTest-248592863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7fe2171c-19d2-4450-8eda-ffd71aea0b72 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:04 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7fe2171c-19d2-4450-8eda-ffd71aea0b72 tempest-CreateVolumesFromSnapshotTest-248592863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:49:04 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7fe2171c-19d2-4450-8eda-ffd71aea0b72 tempest-CreateVolumesFromSnapshotTest-248592863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:49:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7fe2171c-19d2-4450-8eda-ffd71aea0b72 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7fe2171c-19d2-4450-8eda-ffd71aea0b72 tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:04 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:49:04 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:05 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7fe2171c-19d2-4450-8eda-ffd71aea0b72 tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.561s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:05 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-7fe2171c-19d2-4450-8eda-ffd71aea0b72 tempest-CreateVolumesFromSnapshotTest-248592863 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:49:05 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-7fe2171c-19d2-4450-8eda-ffd71aea0b72 tempest-CreateVolumesFromSnapshotTest-248592863 None] Deleted volume successfully. Jun 04 06:49:05 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-7fe2171c-19d2-4450-8eda-ffd71aea0b72 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "cinder-4f2d4974-1a06-40cf-8f8d-f1f86202f0b1-delete_volume" released by "delete_volume" :: held 1.990s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:49:05 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-fada1fc8-aab4-42d9-9ec4-636dbeee4987 tempest-CreateVolumesFromSnapshotTest-248592863 None] Acquiring lock "cinder-43252fc2-bd40-486e-a130-a088de97bbaf-delete_snapshot" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:05 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-fada1fc8-aab4-42d9-9ec4-636dbeee4987 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "cinder-43252fc2-bd40-486e-a130-a088de97bbaf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:05 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-fada1fc8-aab4-42d9-9ec4-636dbeee4987 tempest-CreateVolumesFromSnapshotTest-248592863 None] Acquiring lock "cinder-quobyte-2ecac708-f3ae-4fef-ac5c-2b884d24ba63" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:05 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-fada1fc8-aab4-42d9-9ec4-636dbeee4987 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "cinder-quobyte-2ecac708-f3ae-4fef-ac5c-2b884d24ba63" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:05 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-fada1fc8-aab4-42d9-9ec4-636dbeee4987 tempest-CreateVolumesFromSnapshotTest-248592863 None] Acquiring lock "cinder-quobyte-43252fc2-bd40-486e-a130-a088de97bbaf" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:05 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-fada1fc8-aab4-42d9-9ec4-636dbeee4987 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "cinder-quobyte-43252fc2-bd40-486e-a130-a088de97bbaf" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:05 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-fada1fc8-aab4-42d9-9ec4-636dbeee4987 tempest-CreateVolumesFromSnapshotTest-248592863 None] Deleting offline snapshot 43252fc2-bd40-486e-a130-a088de97bbaf of volume 2ecac708-f3ae-4fef-ac5c-2b884d24ba63 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:49:05 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-fada1fc8-aab4-42d9-9ec4-636dbeee4987 tempest-CreateVolumesFromSnapshotTest-248592863 None] snapshot_file for this snap is: volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63.43252fc2-bd40-486e-a130-a088de97bbaf {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:49:05 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ae72b2-fcd2-435c-ab97-42d733923eaa]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:49:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fada1fc8-aab4-42d9-9ec4-636dbeee4987 tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63.43252fc2-bd40-486e-a130-a088de97bbaf {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:05 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63.43252fc2-bd40-486e-a130-a088de97bbaf Jun 04 06:49:05 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:06 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fada1fc8-aab4-42d9-9ec4-636dbeee4987 tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63.43252fc2-bd40-486e-a130-a088de97bbaf" returned: 0 in 0.658s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:06 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-fada1fc8-aab4-42d9-9ec4-636dbeee4987 tempest-CreateVolumesFromSnapshotTest-248592863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:49:06 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[94abb803-d56c-42bf-bab4-a4944f67fd5a]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:49:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fada1fc8-aab4-42d9-9ec4-636dbeee4987 tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:06 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63 Jun 04 06:49:06 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:06 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fada1fc8-aab4-42d9-9ec4-636dbeee4987 tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63" returned: 0 in 0.665s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fada1fc8-aab4-42d9-9ec4-636dbeee4987 tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63.43252fc2-bd40-486e-a130-a088de97bbaf {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:06 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63.43252fc2-bd40-486e-a130-a088de97bbaf Jun 04 06:49:06 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:07 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fada1fc8-aab4-42d9-9ec4-636dbeee4987 tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63.43252fc2-bd40-486e-a130-a088de97bbaf" returned: 0 in 0.632s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fada1fc8-aab4-42d9-9ec4-636dbeee4987 tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63.43252fc2-bd40-486e-a130-a088de97bbaf {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:07 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63.43252fc2-bd40-486e-a130-a088de97bbaf Jun 04 06:49:07 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:08 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fada1fc8-aab4-42d9-9ec4-636dbeee4987 tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63.43252fc2-bd40-486e-a130-a088de97bbaf" returned: 0 in 0.557s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:08 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-fada1fc8-aab4-42d9-9ec4-636dbeee4987 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "cinder-quobyte-43252fc2-bd40-486e-a130-a088de97bbaf" released by "_delete_snapshot" :: held 2.609s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:49:08 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-fada1fc8-aab4-42d9-9ec4-636dbeee4987 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "cinder-quobyte-2ecac708-f3ae-4fef-ac5c-2b884d24ba63" released by "delete_snapshot" :: held 2.629s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:49:08 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-fada1fc8-aab4-42d9-9ec4-636dbeee4987 tempest-CreateVolumesFromSnapshotTest-248592863 None] Created reservations ['9ea8d0e1-6163-456f-8d14-41b9bfb67f61', '4f0f3e22-9a87-4c05-a5d0-33ed126683e2', '9b533f5c-d141-4a01-ad28-0f682126f02b', 'f49efb43-eb06-4444-9fdc-912ca1df422a'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:49:08 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-fada1fc8-aab4-42d9-9ec4-636dbeee4987 tempest-CreateVolumesFromSnapshotTest-248592863 None] Delete snapshot completed successfully. Jun 04 06:49:08 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-fada1fc8-aab4-42d9-9ec4-636dbeee4987 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "cinder-43252fc2-bd40-486e-a130-a088de97bbaf-delete_snapshot" released by "delete_snapshot" :: held 2.753s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:49:08 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-f3987a5b-6fa1-4589-8108-ae8c01a1ed50 tempest-CreateVolumesFromSnapshotTest-248592863 None] Acquiring lock "cinder-2ecac708-f3ae-4fef-ac5c-2b884d24ba63-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:08 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-f3987a5b-6fa1-4589-8108-ae8c01a1ed50 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "cinder-2ecac708-f3ae-4fef-ac5c-2b884d24ba63-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:08 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-f3987a5b-6fa1-4589-8108-ae8c01a1ed50 tempest-CreateVolumesFromSnapshotTest-248592863 None] Acquiring lock "cinder-quobyte-2ecac708-f3ae-4fef-ac5c-2b884d24ba63" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:08 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-f3987a5b-6fa1-4589-8108-ae8c01a1ed50 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "cinder-quobyte-2ecac708-f3ae-4fef-ac5c-2b884d24ba63" acquired by "delete_volume" :: waited 0.013s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:08 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acdde46-c656-44f3-8c66-635df92888ff]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:49:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f3987a5b-6fa1-4589-8108-ae8c01a1ed50 tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:08 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63 Jun 04 06:49:08 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:09 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f3987a5b-6fa1-4589-8108-ae8c01a1ed50 tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63" returned: 0 in 0.681s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f3987a5b-6fa1-4589-8108-ae8c01a1ed50 tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:09 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63 Jun 04 06:49:09 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:10 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f3987a5b-6fa1-4589-8108-ae8c01a1ed50 tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2ecac708-f3ae-4fef-ac5c-2b884d24ba63" returned: 0 in 0.553s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:10 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-f3987a5b-6fa1-4589-8108-ae8c01a1ed50 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "cinder-quobyte-2ecac708-f3ae-4fef-ac5c-2b884d24ba63" released by "delete_volume" :: held 1.288s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:49:10 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-f3987a5b-6fa1-4589-8108-ae8c01a1ed50 tempest-CreateVolumesFromSnapshotTest-248592863 None] Created reservations ['34ab6a5b-aaf3-4e94-8350-27229ec4a91c', 'ae7a80fe-7db9-48ed-9c49-ec77ee633e8b', '0b2f9de5-a156-4c1e-b4b7-1edbb3c157f5', '12cd5065-3c84-4825-b8ac-d4dd484bfab5'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:49:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f3987a5b-6fa1-4589-8108-ae8c01a1ed50 tempest-CreateVolumesFromSnapshotTest-248592863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f3987a5b-6fa1-4589-8108-ae8c01a1ed50 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:10 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f3987a5b-6fa1-4589-8108-ae8c01a1ed50 tempest-CreateVolumesFromSnapshotTest-248592863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:49:10 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f3987a5b-6fa1-4589-8108-ae8c01a1ed50 tempest-CreateVolumesFromSnapshotTest-248592863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:49:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f3987a5b-6fa1-4589-8108-ae8c01a1ed50 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f3987a5b-6fa1-4589-8108-ae8c01a1ed50 tempest-CreateVolumesFromSnapshotTest-248592863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:10 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:49:10 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:10 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f3987a5b-6fa1-4589-8108-ae8c01a1ed50 tempest-CreateVolumesFromSnapshotTest-248592863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.545s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:10 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-f3987a5b-6fa1-4589-8108-ae8c01a1ed50 tempest-CreateVolumesFromSnapshotTest-248592863 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:49:10 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-f3987a5b-6fa1-4589-8108-ae8c01a1ed50 tempest-CreateVolumesFromSnapshotTest-248592863 None] Deleted volume successfully. Jun 04 06:49:10 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-f3987a5b-6fa1-4589-8108-ae8c01a1ed50 tempest-CreateVolumesFromSnapshotTest-248592863 None] Lock "cinder-2ecac708-f3ae-4fef-ac5c-2b884d24ba63-delete_volume" released by "delete_volume" :: held 2.008s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:49:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:49:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:49:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:49:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:11 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:49:11 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:11 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.586s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:11 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:49:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager._thread_info {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:49:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread count: 28 {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 06:49:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread info: [<_MainThread(MainThread, started 131797370544256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 06:49:20 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=38,cinder:INSERT=13,cinder:UPDATE=52,cinder:DELETE=3 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:49:20 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:UPDATE=75,cinder:SELECT=46,cinder:INSERT=19,cinder:DELETE=4 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:49:22 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:49:22 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Flow 'volume_create_manager' (aa33e4e3-a80b-4d6c-8c77-02a2030c47cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:49:22 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20bd5cb6-8b70-408c-bca9-891b47567935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:22 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20bd5cb6-8b70-408c-bca9-891b47567935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-293606866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80dea51f-c91c-4f30-86ba-30231733c704,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f711a2128e485fb32f1a1f33792d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:49:23Z,use_quota=True,user_id='839dd26b571d4e16acae6e4adf1cfa99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:22 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea2d1723-cc3f-40fb-8b70-623d62725efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:22 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea2d1723-cc3f-40fb-8b70-623d62725efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d01fc4-8261-4ecc-9f0c-a7191bade832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d01fc4-8261-4ecc-9f0c-a7191bade832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80dea51f-c91c-4f30-86ba-30231733c704', 'volume_name': 'volume-80dea51f-c91c-4f30-86ba-30231733c704', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7396fd41-b8ea-4928-9c39-d65d180b50b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7396fd41-b8ea-4928-9c39-d65d180b50b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac9e024-7757-4889-becc-b116ff80ebd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:23 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Volume 80dea51f-c91c-4f30-86ba-30231733c704: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80dea51f-c91c-4f30-86ba-30231733c704', 'volume_size': 1} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-293606866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80dea51f-c91c-4f30-86ba-30231733c704,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f711a2128e485fb32f1a1f33792d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:49:23Z,use_quota=True,user_id='839dd26b571d4e16acae6e4adf1cfa99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Creating volume 80dea51f-c91c-4f30-86ba-30231733c704 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:49:23 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-80dea51f-c91c-4f30-86ba-30231733c704 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:49:23 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-80dea51f-c91c-4f30-86ba-30231733c704 1073741824 Jun 04 06:49:23 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] Flow 'volume_create_manager' (3999c67e-1e51-4704-815f-b41e0338f7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf9dcde-c63a-4fa9-ab3d-b2e4c16d84ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf9dcde-c63a-4fa9-ab3d-b2e4c16d84ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-19686322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ae7c388-453c-4fd1-91f9-ac6e988d8ea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20681957ce9443888c4da1cb8072be88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:49:23Z,use_quota=True,user_id='6229d42b43104380b1d4b1bbb4e4a55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f180904-5df6-4b4d-b66b-b6fd9d5f876c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f180904-5df6-4b4d-b66b-b6fd9d5f876c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e7da315-adb6-4f48-ab43-fdb917517fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e7da315-adb6-4f48-ab43-fdb917517fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ae7c388-453c-4fd1-91f9-ac6e988d8ea0', 'volume_name': 'volume-0ae7c388-453c-4fd1-91f9-ac6e988d8ea0', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76193cdc-0f38-4908-a1b8-74c23aa0189b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76193cdc-0f38-4908-a1b8-74c23aa0189b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8bc6e9b-8f67-4d51-a3ff-5ca5c6643981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:23 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] Volume 0ae7c388-453c-4fd1-91f9-ac6e988d8ea0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ae7c388-453c-4fd1-91f9-ac6e988d8ea0', 'volume_size': 1} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] Flow 'volume_create_manager' (857d2455-c426-49d6-8175-a915aba150ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7e3b21d-2d37-4042-817f-fd47181c01a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7e3b21d-2d37-4042-817f-fd47181c01a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1435558176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07a0da3a-f317-43ee-aa34-661724a02c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20681957ce9443888c4da1cb8072be88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:49:23Z,use_quota=True,user_id='6229d42b43104380b1d4b1bbb4e4a55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4173bb68-e75c-4c37-8a2a-4626c8f00cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4173bb68-e75c-4c37-8a2a-4626c8f00cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a35d27d-a925-4c17-b214-640766f81ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a35d27d-a925-4c17-b214-640766f81ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07a0da3a-f317-43ee-aa34-661724a02c77', 'volume_name': 'volume-07a0da3a-f317-43ee-aa34-661724a02c77', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c177dfe4-6aed-4ec6-9355-e3e114954f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c177dfe4-6aed-4ec6-9355-e3e114954f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb27722b-91b1-41fb-8018-ce5436b29cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:23 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] Volume 07a0da3a-f317-43ee-aa34-661724a02c77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07a0da3a-f317-43ee-aa34-661724a02c77', 'volume_size': 1} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] Flow 'volume_create_manager' (1e5ffd47-2da9-441e-9da1-01e05ec212cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24c65b34-e76c-4221-9f1e-0976ae88f8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:23 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24c65b34-e76c-4221-9f1e-0976ae88f8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-977086538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b71ba46-1f30-4170-8238-febfc19ae7b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20681957ce9443888c4da1cb8072be88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:49:24Z,use_quota=True,user_id='6229d42b43104380b1d4b1bbb4e4a55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166bc3a0-b1a6-4abd-9b8e-ca54856b5412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166bc3a0-b1a6-4abd-9b8e-ca54856b5412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (190f5084-00a7-4051-9c21-9eac75050ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (190f5084-00a7-4051-9c21-9eac75050ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b71ba46-1f30-4170-8238-febfc19ae7b4', 'volume_name': 'volume-2b71ba46-1f30-4170-8238-febfc19ae7b4', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d3bc43a-7442-435c-9d4f-501f7758831b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d3bc43a-7442-435c-9d4f-501f7758831b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b201d09-bea3-4366-8cc1-2105a977bf18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:24 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] Volume 2b71ba46-1f30-4170-8238-febfc19ae7b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b71ba46-1f30-4170-8238-febfc19ae7b4', 'volume_size': 1} Jun 04 06:49:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:24 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-80dea51f-c91c-4f30-86ba-30231733c704 1073741824" returned: 0 in 1.299s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-80dea51f-c91c-4f30-86ba-30231733c704 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:24 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-80dea51f-c91c-4f30-86ba-30231733c704 Jun 04 06:49:24 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:24 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:49:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] Flow 'volume_create_manager' (9c83ed98-387f-4a5a-8d28-a07a289f94f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:49:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0108cc19-065a-4bc9-b2da-f03739a22dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0108cc19-065a-4bc9-b2da-f03739a22dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-28138130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4ceba12-ff93-4a9f-9e43-318d7e9cef82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20681957ce9443888c4da1cb8072be88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:49:24Z,use_quota=True,user_id='6229d42b43104380b1d4b1bbb4e4a55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfdf33a0-b44b-4cdf-981a-a53a275e1d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfdf33a0-b44b-4cdf-981a-a53a275e1d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d8e8620-d3ea-44ab-b5f4-3b9213c073ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d8e8620-d3ea-44ab-b5f4-3b9213c073ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4ceba12-ff93-4a9f-9e43-318d7e9cef82', 'volume_name': 'volume-f4ceba12-ff93-4a9f-9e43-318d7e9cef82', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7528abf4-e3d9-4006-ac9d-602fe01fb9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7528abf4-e3d9-4006-ac9d-602fe01fb9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:24 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (703c68e2-75f6-4dfd-aecc-ed7946c4bc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:24 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] Volume f4ceba12-ff93-4a9f-9e43-318d7e9cef82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4ceba12-ff93-4a9f-9e43-318d7e9cef82', 'volume_size': 1} Jun 04 06:49:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:25 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:49:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] Flow 'volume_create_manager' (83eb088b-da28-4b15-a8e6-683f513e2afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:49:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3362fe65-9d29-48b0-ab3b-b6238e87a725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3362fe65-9d29-48b0-ab3b-b6238e87a725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-962863373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2eb60a4-773d-4e15-8514-a42b12817cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20681957ce9443888c4da1cb8072be88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:49:25Z,use_quota=True,user_id='6229d42b43104380b1d4b1bbb4e4a55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf7e25f7-16b0-411e-a8a9-4e1fc45a0411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf7e25f7-16b0-411e-a8a9-4e1fc45a0411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9a6f403-82f7-4bb4-8088-cf56079b38b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9a6f403-82f7-4bb4-8088-cf56079b38b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2eb60a4-773d-4e15-8514-a42b12817cf7', 'volume_name': 'volume-b2eb60a4-773d-4e15-8514-a42b12817cf7', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (102c63e5-5880-4860-9984-1e16e10b2039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (102c63e5-5880-4860-9984-1e16e10b2039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d20e3e5-42da-4653-8603-33cfe6f5b75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:25 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] Volume b2eb60a4-773d-4e15-8514-a42b12817cf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2eb60a4-773d-4e15-8514-a42b12817cf7', 'volume_size': 1} Jun 04 06:49:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:25 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-80dea51f-c91c-4f30-86ba-30231733c704" returned: 0 in 0.865s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:25 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] <== create_volume: return (2259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:49:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.261s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.948s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:25 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-19686322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ae7c388-453c-4fd1-91f9-ac6e988d8ea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20681957ce9443888c4da1cb8072be88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:49:23Z,use_quota=True,user_id='6229d42b43104380b1d4b1bbb4e4a55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:49:25 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] Creating volume 0ae7c388-453c-4fd1-91f9-ac6e988d8ea0 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:49:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:25 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:49:25 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:49:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:25 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:49:25 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:49:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0ae7c388-453c-4fd1-91f9-ac6e988d8ea0 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac9e024-7757-4889-becc-b116ff80ebd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80dea51f-c91c-4f30-86ba-30231733c704', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:25 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0ae7c388-453c-4fd1-91f9-ac6e988d8ea0 1073741824 Jun 04 06:49:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbc3427a-f19c-4baf-a8d6-c8a08c183fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:25 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:25 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Volume volume-80dea51f-c91c-4f30-86ba-30231733c704 (80dea51f-c91c-4f30-86ba-30231733c704): created successfully Jun 04 06:49:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbc3427a-f19c-4baf-a8d6-c8a08c183fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:25 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Flow 'volume_create_manager' (aa33e4e3-a80b-4d6c-8c77-02a2030c47cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:49:25 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-c0f0e839-1cfa-45ba-a15a-f0d7c11d564e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Created volume successfully. Jun 04 06:49:26 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0ae7c388-453c-4fd1-91f9-ac6e988d8ea0 1073741824" returned: 0 in 0.931s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0ae7c388-453c-4fd1-91f9-ac6e988d8ea0 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:26 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0ae7c388-453c-4fd1-91f9-ac6e988d8ea0 Jun 04 06:49:26 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:26 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:49:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Flow 'volume_create_manager' (2cdd6b36-5f4a-46bd-9b8e-4bf8d1cd9773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:49:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a102c91-1818-40e0-8310-ccba42851a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a102c91-1818-40e0-8310-ccba42851a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-57338727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=119ae78a-4502-4418-aa1b-05f9ddae2046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f711a2128e485fb32f1a1f33792d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:49:26Z,use_quota=True,user_id='839dd26b571d4e16acae6e4adf1cfa99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19647305-ff10-4822-9fa4-d4a5036be0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19647305-ff10-4822-9fa4-d4a5036be0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f70769f-eabe-4caa-b462-326d3d60213b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f70769f-eabe-4caa-b462-326d3d60213b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '119ae78a-4502-4418-aa1b-05f9ddae2046', 'volume_name': 'volume-119ae78a-4502-4418-aa1b-05f9ddae2046', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (462e059a-2096-48ca-aa8e-5f782ada4ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (462e059a-2096-48ca-aa8e-5f782ada4ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59071cef-c0ed-463c-b7a8-e191f1ff4483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:26 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Volume 119ae78a-4502-4418-aa1b-05f9ddae2046: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-119ae78a-4502-4418-aa1b-05f9ddae2046', 'volume_size': 1} Jun 04 06:49:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:26 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:49:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Flow 'volume_create_manager' (8b6b8e2e-3e90-49f1-a0ac-2967122ff701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:49:26 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdbe5c05-1f21-420a-8615-b330b8835bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdbe5c05-1f21-420a-8615-b330b8835bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-584214131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f620ca5d-8ba8-4de1-b296-35d26d42e7b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f711a2128e485fb32f1a1f33792d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:49:27Z,use_quota=True,user_id='839dd26b571d4e16acae6e4adf1cfa99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ad356ef-359a-4e61-83ed-28c14838cb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ad356ef-359a-4e61-83ed-28c14838cb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6830e12e-1f9b-4634-98b3-0c49cdebf07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6830e12e-1f9b-4634-98b3-0c49cdebf07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f620ca5d-8ba8-4de1-b296-35d26d42e7b8', 'volume_name': 'volume-f620ca5d-8ba8-4de1-b296-35d26d42e7b8', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebaa24ca-4ced-422b-8e03-5174e2fd76f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebaa24ca-4ced-422b-8e03-5174e2fd76f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b850d911-92e2-486c-998d-c27c719a38af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:27 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Volume f620ca5d-8ba8-4de1-b296-35d26d42e7b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f620ca5d-8ba8-4de1-b296-35d26d42e7b8', 'volume_size': 1} Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:27 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0ae7c388-453c-4fd1-91f9-ac6e988d8ea0" returned: 0 in 0.997s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] <== create_volume: return (1992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.996s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.683s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1435558176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07a0da3a-f317-43ee-aa34-661724a02c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20681957ce9443888c4da1cb8072be88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:49:23Z,use_quota=True,user_id='6229d42b43104380b1d4b1bbb4e4a55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] Creating volume 07a0da3a-f317-43ee-aa34-661724a02c77 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:49:27 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-07a0da3a-f317-43ee-aa34-661724a02c77 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8bc6e9b-8f67-4d51-a3ff-5ca5c6643981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ae7c388-453c-4fd1-91f9-ac6e988d8ea0', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:27 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-07a0da3a-f317-43ee-aa34-661724a02c77 1073741824 Jun 04 06:49:27 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc72f92-9868-4729-a778-d7d81235da82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:27 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] Volume volume-0ae7c388-453c-4fd1-91f9-ac6e988d8ea0 (0ae7c388-453c-4fd1-91f9-ac6e988d8ea0): created successfully Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc72f92-9868-4729-a778-d7d81235da82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] Flow 'volume_create_manager' (3999c67e-1e51-4704-815f-b41e0338f7d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:49:27 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-fa9771c8-7e9a-4315-8303-0271f6abb06b tempest-CreateVolumesFromImageTest-2109098695 None] Created volume successfully. Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Flow 'volume_create_manager' (72a1a9a1-6937-421f-a339-eda87776b9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc93e05-0741-48e0-96a0-78f30c5cc2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc93e05-0741-48e0-96a0-78f30c5cc2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1710501115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=122c4caa-c0d3-4db4-bf13-fb7c625abd3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f711a2128e485fb32f1a1f33792d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:49:27Z,use_quota=True,user_id='839dd26b571d4e16acae6e4adf1cfa99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (005fc089-67a8-4d4b-bca5-db57b54b9cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (005fc089-67a8-4d4b-bca5-db57b54b9cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70f5c60a-a1fe-46b5-89f0-18cf8d2def22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70f5c60a-a1fe-46b5-89f0-18cf8d2def22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '122c4caa-c0d3-4db4-bf13-fb7c625abd3c', 'volume_name': 'volume-122c4caa-c0d3-4db4-bf13-fb7c625abd3c', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878acc76-255e-42ce-ad7c-f3375050c53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878acc76-255e-42ce-ad7c-f3375050c53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0918f41-8440-4285-81fe-973f813d6df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:27 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Volume 122c4caa-c0d3-4db4-bf13-fb7c625abd3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-122c4caa-c0d3-4db4-bf13-fb7c625abd3c', 'volume_size': 1} Jun 04 06:49:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Flow 'volume_create_manager' (e4b8aeea-2972-44d6-ab15-ef82a650b2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54897b55-546c-442c-ac1f-02b9eb88c347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54897b55-546c-442c-ac1f-02b9eb88c347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c708ad85-c23b-47f2-b443-b17da0e2e47f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e89a7bd5ea3b4dd4a1c66f98c4da9137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:49:28Z,use_quota=True,user_id='90b9f7a11f5e407e822eeb5718bc3453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98516ab-8da6-4eec-b029-f4cdb3b55278),volume_type_id=d98516ab-8da6-4eec-b029-f4cdb3b55278)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47064ded-d220-4ec1-89cc-b49929261be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47064ded-d220-4ec1-89cc-b49929261be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1760790c-2765-48e4-8ea6-0c191d09b979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.image.glance [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Creating Keystone auth plugin from conf {{(pid=86069) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Flow 'volume_create_manager' (efefd061-31f8-443d-935e-893ff3b55ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f3eb2b0-091e-4fc7-a72c-d98e12e3c645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f3eb2b0-091e-4fc7-a72c-d98e12e3c645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-20081838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0177539c-98bb-4290-8357-1da8dc50ed6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f711a2128e485fb32f1a1f33792d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:49:28Z,use_quota=True,user_id='839dd26b571d4e16acae6e4adf1cfa99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae1ea2d0-c77e-4e3c-9e62-9224c47c2977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae1ea2d0-c77e-4e3c-9e62-9224c47c2977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f0bc84d-71e4-4495-8c88-d03ff80969ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f0bc84d-71e4-4495-8c88-d03ff80969ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0177539c-98bb-4290-8357-1da8dc50ed6a', 'volume_name': 'volume-0177539c-98bb-4290-8357-1da8dc50ed6a', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (302bf110-b147-448a-897f-31f7274eac3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (302bf110-b147-448a-897f-31f7274eac3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (357474c5-fd64-4947-8a16-69ae33a6da4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:28 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Volume 0177539c-98bb-4290-8357-1da8dc50ed6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0177539c-98bb-4290-8357-1da8dc50ed6a', 'volume_size': 1} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:28 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-07a0da3a-f317-43ee-aa34-661724a02c77 1073741824" returned: 0 in 1.303s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-07a0da3a-f317-43ee-aa34-661724a02c77 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:28 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-07a0da3a-f317-43ee-aa34-661724a02c77 Jun 04 06:49:28 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Flow 'volume_create_manager' (1707366b-fb4c-476f-8971-c28eb7ab5da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1c8233f-0b24-41b3-b8cb-4786e23447aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1c8233f-0b24-41b3-b8cb-4786e23447aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1771214987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63da0196-7f51-4e3e-83b5-4618adf78b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f711a2128e485fb32f1a1f33792d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:49:29Z,use_quota=True,user_id='839dd26b571d4e16acae6e4adf1cfa99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ba654a-7482-4472-85cb-6fb8ccf1f6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ba654a-7482-4472-85cb-6fb8ccf1f6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cbb65aa-3fb8-42e8-ae21-9febae92da9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cbb65aa-3fb8-42e8-ae21-9febae92da9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63da0196-7f51-4e3e-83b5-4618adf78b10', 'volume_name': 'volume-63da0196-7f51-4e3e-83b5-4618adf78b10', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb9d1bdf-4a9e-4f0c-9002-7e734540387a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb9d1bdf-4a9e-4f0c-9002-7e734540387a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a96aa1ce-6e7f-44f4-b64c-ba7a8a110ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:28 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Volume 63da0196-7f51-4e3e-83b5-4618adf78b10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63da0196-7f51-4e3e-83b5-4618adf78b10', 'volume_size': 1} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1760790c-2765-48e4-8ea6-0c191d09b979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c708ad85-c23b-47f2-b443-b17da0e2e47f', 'volume_name': 'volume-c708ad85-c23b-47f2-b443-b17da0e2e47f', 'volume_size': 1, 'image_id': '9bd586b1-3435-44f9-aa60-a97c0eb713c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bd586b1-3435-44f9-aa60-a97c0eb713c6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5f3c6e4b58ab27fa4635c1e7c155be97', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e89a7bd5ea3b4dd4a1c66f98c4da9137', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '261dccba788a554aa54aa1d568e2e7406ccaa4d5c8416a28cd5c7ed0f1a7a97a09a3dde3b873ff821898870319b4114c9c745ccb1c5ab6ea368fd97ec46df4a6', 'id': '9bd586b1-3435-44f9-aa60-a97c0eb713c6', 'created_at': datetime.datetime(2026, 6, 4, 4, 49, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 4, 49, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bd586b1-3435-44f9-aa60-a97c0eb713c6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b65d16d-6167-472d-9b67-a949217f33e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b65d16d-6167-472d-9b67-a949217f33e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29df2dd4-8a1b-4c9a-8fb4-4e41c4a9b029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:28 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Volume c708ad85-c23b-47f2-b443-b17da0e2e47f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c708ad85-c23b-47f2-b443-b17da0e2e47f', 'volume_size': 1, 'image_id': '9bd586b1-3435-44f9-aa60-a97c0eb713c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bd586b1-3435-44f9-aa60-a97c0eb713c6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5f3c6e4b58ab27fa4635c1e7c155be97', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e89a7bd5ea3b4dd4a1c66f98c4da9137', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '261dccba788a554aa54aa1d568e2e7406ccaa4d5c8416a28cd5c7ed0f1a7a97a09a3dde3b873ff821898870319b4114c9c745ccb1c5ab6ea368fd97ec46df4a6', 'id': '9bd586b1-3435-44f9-aa60-a97c0eb713c6', 'created_at': datetime.datetime(2026, 6, 4, 4, 49, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 4, 49, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bd586b1-3435-44f9-aa60-a97c0eb713c6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Trying to clone c708ad85-c23b-47f2-b443-b17da0e2e47f from image 9bd586b1-3435-44f9-aa60-a97c0eb713c6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9bd586b1-3435-44f9-aa60-a97c0eb713c6', 'metadata': {}}]). {{(pid=86069) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 04 06:49:28 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9bd586b1-3435-44f9-aa60-a97c0eb713c6_salh8ihmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86069) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 04 06:49:28 devstack cinder-volume[86069]: INFO cinder.image.image_utils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Image download 0.00 MB at 0.00 MB/s Jun 04 06:49:29 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b4996e-285b-44c0-bd4d-635925574d82]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:49:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd586b1-3435-44f9-aa60-a97c0eb713c6_salh8ihmdevstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:29 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd586b1-3435-44f9-aa60-a97c0eb713c6_salh8ihmdevstack@QuobyteHD Jun 04 06:49:29 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:29 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-07a0da3a-f317-43ee-aa34-661724a02c77" returned: 0 in 0.653s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:29 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] <== create_volume: return (2015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:49:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.019s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.270s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:29 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-977086538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b71ba46-1f30-4170-8238-febfc19ae7b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20681957ce9443888c4da1cb8072be88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:49:24Z,use_quota=True,user_id='6229d42b43104380b1d4b1bbb4e4a55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:49:29 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] Creating volume 2b71ba46-1f30-4170-8238-febfc19ae7b4 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:49:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:29 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:49:29 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:49:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:29 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:49:29 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:49:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2b71ba46-1f30-4170-8238-febfc19ae7b4 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb27722b-91b1-41fb-8018-ce5436b29cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07a0da3a-f317-43ee-aa34-661724a02c77', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:29 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2b71ba46-1f30-4170-8238-febfc19ae7b4 1073741824 Jun 04 06:49:29 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3efe0c-074c-47e6-b50b-1c2d70a0f2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:29 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] Volume volume-07a0da3a-f317-43ee-aa34-661724a02c77 (07a0da3a-f317-43ee-aa34-661724a02c77): created successfully Jun 04 06:49:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3efe0c-074c-47e6-b50b-1c2d70a0f2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] Flow 'volume_create_manager' (857d2455-c426-49d6-8175-a915aba150ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:49:29 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-b0df5fa5-fca7-4634-96a6-66ca1b3d100d tempest-CreateVolumesFromImageTest-2109098695 None] Created volume successfully. Jun 04 06:49:29 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd586b1-3435-44f9-aa60-a97c0eb713c6_salh8ihmdevstack@QuobyteHD" returned: 0 in 0.771s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd586b1-3435-44f9-aa60-a97c0eb713c6_salh8ihmdevstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:29 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd586b1-3435-44f9-aa60-a97c0eb713c6_salh8ihmdevstack@QuobyteHD Jun 04 06:49:29 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:30 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2b71ba46-1f30-4170-8238-febfc19ae7b4 1073741824" returned: 0 in 0.854s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2b71ba46-1f30-4170-8238-febfc19ae7b4 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:30 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2b71ba46-1f30-4170-8238-febfc19ae7b4 Jun 04 06:49:30 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:30 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd586b1-3435-44f9-aa60-a97c0eb713c6_salh8ihmdevstack@QuobyteHD" returned: 1 in 0.772s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd586b1-3435-44f9-aa60-a97c0eb713c6_salh8ihmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:49:30 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Temporary image 9bd586b1-3435-44f9-aa60-a97c0eb713c6 is fetched for user 90b9f7a11f5e407e822eeb5718bc3453. {{(pid=86069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 04 06:49:30 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbd45c8-e79b-4849-8965-3c64267cc4c1]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:49:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd586b1-3435-44f9-aa60-a97c0eb713c6_salh8ihmdevstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:30 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd586b1-3435-44f9-aa60-a97c0eb713c6_salh8ihmdevstack@QuobyteHD Jun 04 06:49:30 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:30 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2b71ba46-1f30-4170-8238-febfc19ae7b4" returned: 0 in 0.629s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:49:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.240s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-28138130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4ceba12-ff93-4a9f-9e43-318d7e9cef82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20681957ce9443888c4da1cb8072be88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:49:24Z,use_quota=True,user_id='6229d42b43104380b1d4b1bbb4e4a55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:49:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] Creating volume f4ceba12-ff93-4a9f-9e43-318d7e9cef82 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:49:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:49:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:49:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:49:30 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:49:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f4ceba12-ff93-4a9f-9e43-318d7e9cef82 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b201d09-bea3-4366-8cc1-2105a977bf18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b71ba46-1f30-4170-8238-febfc19ae7b4', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:30 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f4ceba12-ff93-4a9f-9e43-318d7e9cef82 1073741824 Jun 04 06:49:30 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4bf510b-5738-437d-8ade-7b157c4f989e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:30 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] Volume volume-2b71ba46-1f30-4170-8238-febfc19ae7b4 (2b71ba46-1f30-4170-8238-febfc19ae7b4): created successfully Jun 04 06:49:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4bf510b-5738-437d-8ade-7b157c4f989e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] Flow 'volume_create_manager' (1e5ffd47-2da9-441e-9da1-01e05ec212cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:49:30 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-f46c1af5-e0ac-40e6-a5d8-3527365b984f tempest-CreateVolumesFromImageTest-2109098695 None] Created volume successfully. Jun 04 06:49:31 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd586b1-3435-44f9-aa60-a97c0eb713c6_salh8ihmdevstack@QuobyteHD" returned: 0 in 0.854s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd586b1-3435-44f9-aa60-a97c0eb713c6_salh8ihmdevstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:31 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd586b1-3435-44f9-aa60-a97c0eb713c6_salh8ihmdevstack@QuobyteHD Jun 04 06:49:31 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:31 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f4ceba12-ff93-4a9f-9e43-318d7e9cef82 1073741824" returned: 0 in 0.864s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f4ceba12-ff93-4a9f-9e43-318d7e9cef82 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:31 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f4ceba12-ff93-4a9f-9e43-318d7e9cef82 Jun 04 06:49:31 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:32 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd586b1-3435-44f9-aa60-a97c0eb713c6_salh8ihmdevstack@QuobyteHD" returned: 1 in 0.748s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd586b1-3435-44f9-aa60-a97c0eb713c6_salh8ihmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:49:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:32 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f4ceba12-ff93-4a9f-9e43-318d7e9cef82" returned: 0 in 0.676s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:32 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:49:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.222s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:32 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-962863373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2eb60a4-773d-4e15-8514-a42b12817cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20681957ce9443888c4da1cb8072be88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:49:25Z,use_quota=True,user_id='6229d42b43104380b1d4b1bbb4e4a55c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:49:32 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] Creating volume b2eb60a4-773d-4e15-8514-a42b12817cf7 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:49:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:32 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:49:32 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:49:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:32 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:49:32 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:49:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b2eb60a4-773d-4e15-8514-a42b12817cf7 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:32 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (703c68e2-75f6-4dfd-aecc-ed7946c4bc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4ceba12-ff93-4a9f-9e43-318d7e9cef82', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:32 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e22b3183-c6a6-4dd3-80ea-56571944714d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:32 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b2eb60a4-773d-4e15-8514-a42b12817cf7 1073741824 Jun 04 06:49:32 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:32 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] Volume volume-f4ceba12-ff93-4a9f-9e43-318d7e9cef82 (f4ceba12-ff93-4a9f-9e43-318d7e9cef82): created successfully Jun 04 06:49:32 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e22b3183-c6a6-4dd3-80ea-56571944714d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:32 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] Flow 'volume_create_manager' (9c83ed98-387f-4a5a-8d28-a07a289f94f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:49:32 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-ffb1314e-0f6d-4a27-ae2f-7585c36e65fb tempest-CreateVolumesFromImageTest-2109098695 None] Created volume successfully. Jun 04 06:49:33 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b2eb60a4-773d-4e15-8514-a42b12817cf7 1073741824" returned: 0 in 0.911s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b2eb60a4-773d-4e15-8514-a42b12817cf7 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:33 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b2eb60a4-773d-4e15-8514-a42b12817cf7 Jun 04 06:49:33 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:34 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b2eb60a4-773d-4e15-8514-a42b12817cf7" returned: 0 in 0.673s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:49:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.322s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-57338727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=119ae78a-4502-4418-aa1b-05f9ddae2046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f711a2128e485fb32f1a1f33792d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:49:26Z,use_quota=True,user_id='839dd26b571d4e16acae6e4adf1cfa99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:49:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Creating volume 119ae78a-4502-4418-aa1b-05f9ddae2046 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:49:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:49:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:49:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:49:34 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:49:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-119ae78a-4502-4418-aa1b-05f9ddae2046 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:34 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d20e3e5-42da-4653-8603-33cfe6f5b75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2eb60a4-773d-4e15-8514-a42b12817cf7', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:34 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-119ae78a-4502-4418-aa1b-05f9ddae2046 1073741824 Jun 04 06:49:34 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:34 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72bcaea0-76ef-4a43-8a28-a2e2eb92b3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:34 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] Volume volume-b2eb60a4-773d-4e15-8514-a42b12817cf7 (b2eb60a4-773d-4e15-8514-a42b12817cf7): created successfully Jun 04 06:49:34 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72bcaea0-76ef-4a43-8a28-a2e2eb92b3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:34 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] Flow 'volume_create_manager' (83eb088b-da28-4b15-a8e6-683f513e2afb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:49:34 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-361bbd08-8fdc-4036-bf89-56095999c831 tempest-CreateVolumesFromImageTest-2109098695 None] Created volume successfully. Jun 04 06:49:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-548684f5-8813-4ea7-8528-418ed9d1c733 tempest-CreateVolumesFromImageTest-2109098695 None] Acquiring lock "cinder-b2eb60a4-773d-4e15-8514-a42b12817cf7-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-548684f5-8813-4ea7-8528-418ed9d1c733 tempest-CreateVolumesFromImageTest-2109098695 None] Lock "cinder-b2eb60a4-773d-4e15-8514-a42b12817cf7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-548684f5-8813-4ea7-8528-418ed9d1c733 tempest-CreateVolumesFromImageTest-2109098695 None] Acquiring lock "cinder-quobyte-b2eb60a4-773d-4e15-8514-a42b12817cf7" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:34 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-548684f5-8813-4ea7-8528-418ed9d1c733 tempest-CreateVolumesFromImageTest-2109098695 None] Lock "cinder-quobyte-b2eb60a4-773d-4e15-8514-a42b12817cf7" acquired by "delete_volume" :: waited 0.018s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:34 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f71385-0b44-4956-b99f-56759e24fd67]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:49:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-548684f5-8813-4ea7-8528-418ed9d1c733 tempest-CreateVolumesFromImageTest-2109098695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b2eb60a4-773d-4e15-8514-a42b12817cf7 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:34 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b2eb60a4-773d-4e15-8514-a42b12817cf7 Jun 04 06:49:34 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:34 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-119ae78a-4502-4418-aa1b-05f9ddae2046 1073741824" returned: 0 in 0.853s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-119ae78a-4502-4418-aa1b-05f9ddae2046 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:35 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-119ae78a-4502-4418-aa1b-05f9ddae2046 Jun 04 06:49:35 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:35 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-548684f5-8813-4ea7-8528-418ed9d1c733 tempest-CreateVolumesFromImageTest-2109098695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b2eb60a4-773d-4e15-8514-a42b12817cf7" returned: 0 in 0.795s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-548684f5-8813-4ea7-8528-418ed9d1c733 tempest-CreateVolumesFromImageTest-2109098695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b2eb60a4-773d-4e15-8514-a42b12817cf7 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:35 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b2eb60a4-773d-4e15-8514-a42b12817cf7 Jun 04 06:49:35 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:35 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-119ae78a-4502-4418-aa1b-05f9ddae2046" returned: 0 in 0.713s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:49:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.650s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-584214131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f620ca5d-8ba8-4de1-b296-35d26d42e7b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f711a2128e485fb32f1a1f33792d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:49:27Z,use_quota=True,user_id='839dd26b571d4e16acae6e4adf1cfa99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:49:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Creating volume f620ca5d-8ba8-4de1-b296-35d26d42e7b8 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:49:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:49:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:49:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:49:35 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:49:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f620ca5d-8ba8-4de1-b296-35d26d42e7b8 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:35 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59071cef-c0ed-463c-b7a8-e191f1ff4483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-119ae78a-4502-4418-aa1b-05f9ddae2046', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:35 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e492d768-3749-4a08-ab45-5465a2e4a822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:35 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f620ca5d-8ba8-4de1-b296-35d26d42e7b8 1073741824 Jun 04 06:49:35 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:35 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Volume volume-119ae78a-4502-4418-aa1b-05f9ddae2046 (119ae78a-4502-4418-aa1b-05f9ddae2046): created successfully Jun 04 06:49:35 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e492d768-3749-4a08-ab45-5465a2e4a822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:35 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Flow 'volume_create_manager' (2cdd6b36-5f4a-46bd-9b8e-4bf8d1cd9773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:49:35 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-bca0fe8b-669d-4b31-abcd-b93adea8fdf9 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Created volume successfully. Jun 04 06:49:35 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-548684f5-8813-4ea7-8528-418ed9d1c733 tempest-CreateVolumesFromImageTest-2109098695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-b2eb60a4-773d-4e15-8514-a42b12817cf7" returned: 0 in 0.676s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:35 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-548684f5-8813-4ea7-8528-418ed9d1c733 tempest-CreateVolumesFromImageTest-2109098695 None] Lock "cinder-quobyte-b2eb60a4-773d-4e15-8514-a42b12817cf7" released by "delete_volume" :: held 1.524s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:49:35 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-548684f5-8813-4ea7-8528-418ed9d1c733 tempest-CreateVolumesFromImageTest-2109098695 None] Created reservations ['20036be0-23ed-460b-a6b6-41fc77d4354e', '55b0b60a-8eff-41f9-8e83-57682b063b6a', '50c0e307-c59a-4a0d-b196-eed18a8d06b1', '1c8dd530-f2a0-4f0d-be2d-d5aa131450e6'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:49:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-548684f5-8813-4ea7-8528-418ed9d1c733 tempest-CreateVolumesFromImageTest-2109098695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-548684f5-8813-4ea7-8528-418ed9d1c733 tempest-CreateVolumesFromImageTest-2109098695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:36 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-548684f5-8813-4ea7-8528-418ed9d1c733 tempest-CreateVolumesFromImageTest-2109098695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:49:36 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-548684f5-8813-4ea7-8528-418ed9d1c733 tempest-CreateVolumesFromImageTest-2109098695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:49:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-548684f5-8813-4ea7-8528-418ed9d1c733 tempest-CreateVolumesFromImageTest-2109098695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-548684f5-8813-4ea7-8528-418ed9d1c733 tempest-CreateVolumesFromImageTest-2109098695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:36 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:49:36 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:36 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f620ca5d-8ba8-4de1-b296-35d26d42e7b8 1073741824" returned: 0 in 0.867s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f620ca5d-8ba8-4de1-b296-35d26d42e7b8 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:36 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f620ca5d-8ba8-4de1-b296-35d26d42e7b8 Jun 04 06:49:36 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:36 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-04b665d5-608c-4322-93dd-0e716738d3f7 tempest-CreateVolumesFromImageTest-2109098695 None] Acquiring lock "cinder-f4ceba12-ff93-4a9f-9e43-318d7e9cef82-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:36 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-04b665d5-608c-4322-93dd-0e716738d3f7 tempest-CreateVolumesFromImageTest-2109098695 None] Lock "cinder-f4ceba12-ff93-4a9f-9e43-318d7e9cef82-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:36 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-04b665d5-608c-4322-93dd-0e716738d3f7 tempest-CreateVolumesFromImageTest-2109098695 None] Acquiring lock "cinder-quobyte-f4ceba12-ff93-4a9f-9e43-318d7e9cef82" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:36 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-04b665d5-608c-4322-93dd-0e716738d3f7 tempest-CreateVolumesFromImageTest-2109098695 None] Lock "cinder-quobyte-f4ceba12-ff93-4a9f-9e43-318d7e9cef82" acquired by "delete_volume" :: waited 0.029s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:36 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a71e326-ca81-4a5c-9f04-cce5e5fd3ea5]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:49:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-04b665d5-608c-4322-93dd-0e716738d3f7 tempest-CreateVolumesFromImageTest-2109098695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f4ceba12-ff93-4a9f-9e43-318d7e9cef82 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:36 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-548684f5-8813-4ea7-8528-418ed9d1c733 tempest-CreateVolumesFromImageTest-2109098695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.905s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:36 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-548684f5-8813-4ea7-8528-418ed9d1c733 tempest-CreateVolumesFromImageTest-2109098695 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:49:36 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-548684f5-8813-4ea7-8528-418ed9d1c733 tempest-CreateVolumesFromImageTest-2109098695 None] Deleted volume successfully. Jun 04 06:49:36 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-548684f5-8813-4ea7-8528-418ed9d1c733 tempest-CreateVolumesFromImageTest-2109098695 None] Lock "cinder-b2eb60a4-773d-4e15-8514-a42b12817cf7-delete_volume" released by "delete_volume" :: held 2.641s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:49:37 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f4ceba12-ff93-4a9f-9e43-318d7e9cef82 Jun 04 06:49:37 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:37 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f620ca5d-8ba8-4de1-b296-35d26d42e7b8" returned: 0 in 0.803s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:37 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:49:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.819s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:37 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1710501115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=122c4caa-c0d3-4db4-bf13-fb7c625abd3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f711a2128e485fb32f1a1f33792d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:49:27Z,use_quota=True,user_id='839dd26b571d4e16acae6e4adf1cfa99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:49:37 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Creating volume 122c4caa-c0d3-4db4-bf13-fb7c625abd3c {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:49:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:37 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:49:37 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:49:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:37 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:49:37 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:49:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-122c4caa-c0d3-4db4-bf13-fb7c625abd3c 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b850d911-92e2-486c-998d-c27c719a38af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f620ca5d-8ba8-4de1-b296-35d26d42e7b8', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (926e3fbc-5307-4db5-8809-6a98a00819b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:37 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-122c4caa-c0d3-4db4-bf13-fb7c625abd3c 1073741824 Jun 04 06:49:37 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:37 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Volume volume-f620ca5d-8ba8-4de1-b296-35d26d42e7b8 (f620ca5d-8ba8-4de1-b296-35d26d42e7b8): created successfully Jun 04 06:49:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (926e3fbc-5307-4db5-8809-6a98a00819b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Flow 'volume_create_manager' (8b6b8e2e-3e90-49f1-a0ac-2967122ff701) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:49:37 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-94b41ea8-ccc7-4b92-b7f7-63006b7f0f44 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Created volume successfully. Jun 04 06:49:37 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-04b665d5-608c-4322-93dd-0e716738d3f7 tempest-CreateVolumesFromImageTest-2109098695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f4ceba12-ff93-4a9f-9e43-318d7e9cef82" returned: 0 in 0.792s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-04b665d5-608c-4322-93dd-0e716738d3f7 tempest-CreateVolumesFromImageTest-2109098695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f4ceba12-ff93-4a9f-9e43-318d7e9cef82 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:37 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f4ceba12-ff93-4a9f-9e43-318d7e9cef82 Jun 04 06:49:37 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:38 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-122c4caa-c0d3-4db4-bf13-fb7c625abd3c 1073741824" returned: 0 in 0.937s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:38 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-04b665d5-608c-4322-93dd-0e716738d3f7 tempest-CreateVolumesFromImageTest-2109098695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f4ceba12-ff93-4a9f-9e43-318d7e9cef82" returned: 0 in 0.693s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:38 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-04b665d5-608c-4322-93dd-0e716738d3f7 tempest-CreateVolumesFromImageTest-2109098695 None] Lock "cinder-quobyte-f4ceba12-ff93-4a9f-9e43-318d7e9cef82" released by "delete_volume" :: held 1.549s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:49:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-122c4caa-c0d3-4db4-bf13-fb7c625abd3c {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:38 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-122c4caa-c0d3-4db4-bf13-fb7c625abd3c Jun 04 06:49:38 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:38 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-04b665d5-608c-4322-93dd-0e716738d3f7 tempest-CreateVolumesFromImageTest-2109098695 None] Created reservations ['bdde72eb-bf18-4a80-9f2d-7788d2269afa', 'bab802c9-7610-4a9f-a12c-8194d0101789', 'efa65e98-f6c7-4422-af78-084b8ac182b9', '59792432-8385-40a0-968b-e8699fc56483'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:49:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-04b665d5-608c-4322-93dd-0e716738d3f7 tempest-CreateVolumesFromImageTest-2109098695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-04b665d5-608c-4322-93dd-0e716738d3f7 tempest-CreateVolumesFromImageTest-2109098695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:38 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-04b665d5-608c-4322-93dd-0e716738d3f7 tempest-CreateVolumesFromImageTest-2109098695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:49:38 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-04b665d5-608c-4322-93dd-0e716738d3f7 tempest-CreateVolumesFromImageTest-2109098695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:49:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-04b665d5-608c-4322-93dd-0e716738d3f7 tempest-CreateVolumesFromImageTest-2109098695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-04b665d5-608c-4322-93dd-0e716738d3f7 tempest-CreateVolumesFromImageTest-2109098695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:38 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:49:38 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:39 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-122c4caa-c0d3-4db4-bf13-fb7c625abd3c" returned: 0 in 0.611s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:39 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:49:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.677s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:39 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-20081838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0177539c-98bb-4290-8357-1da8dc50ed6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f711a2128e485fb32f1a1f33792d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:49:28Z,use_quota=True,user_id='839dd26b571d4e16acae6e4adf1cfa99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:49:39 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Creating volume 0177539c-98bb-4290-8357-1da8dc50ed6a {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:49:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:39 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:49:39 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:49:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:39 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:49:39 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:49:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0177539c-98bb-4290-8357-1da8dc50ed6a 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ec8468dd-bd08-4747-ba1d-6a7664de0b8c tempest-CreateVolumesFromImageTest-2109098695 None] Acquiring lock "cinder-2b71ba46-1f30-4170-8238-febfc19ae7b4-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0918f41-8440-4285-81fe-973f813d6df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-122c4caa-c0d3-4db4-bf13-fb7c625abd3c', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:39 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0177539c-98bb-4290-8357-1da8dc50ed6a 1073741824 Jun 04 06:49:39 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3396f1c2-9dec-4c39-b872-199a21d873f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ec8468dd-bd08-4747-ba1d-6a7664de0b8c tempest-CreateVolumesFromImageTest-2109098695 None] Lock "cinder-2b71ba46-1f30-4170-8238-febfc19ae7b4-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:39 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Volume volume-122c4caa-c0d3-4db4-bf13-fb7c625abd3c (122c4caa-c0d3-4db4-bf13-fb7c625abd3c): created successfully Jun 04 06:49:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3396f1c2-9dec-4c39-b872-199a21d873f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Flow 'volume_create_manager' (72a1a9a1-6937-421f-a339-eda87776b9a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:49:39 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-cd2e49f0-0efa-4572-ba8d-b97b153c8528 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Created volume successfully. Jun 04 06:49:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ec8468dd-bd08-4747-ba1d-6a7664de0b8c tempest-CreateVolumesFromImageTest-2109098695 None] Acquiring lock "cinder-quobyte-2b71ba46-1f30-4170-8238-febfc19ae7b4" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:39 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ec8468dd-bd08-4747-ba1d-6a7664de0b8c tempest-CreateVolumesFromImageTest-2109098695 None] Lock "cinder-quobyte-2b71ba46-1f30-4170-8238-febfc19ae7b4" acquired by "delete_volume" :: waited 0.026s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-04b665d5-608c-4322-93dd-0e716738d3f7 tempest-CreateVolumesFromImageTest-2109098695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.753s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:39 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-04b665d5-608c-4322-93dd-0e716738d3f7 tempest-CreateVolumesFromImageTest-2109098695 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:49:39 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-04b665d5-608c-4322-93dd-0e716738d3f7 tempest-CreateVolumesFromImageTest-2109098695 None] Deleted volume successfully. Jun 04 06:49:39 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af6532d-cd0b-4d45-9c3d-fd125af76fb8]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:49:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ec8468dd-bd08-4747-ba1d-6a7664de0b8c tempest-CreateVolumesFromImageTest-2109098695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2b71ba46-1f30-4170-8238-febfc19ae7b4 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-04b665d5-608c-4322-93dd-0e716738d3f7 tempest-CreateVolumesFromImageTest-2109098695 None] Lock "cinder-f4ceba12-ff93-4a9f-9e43-318d7e9cef82-delete_volume" released by "delete_volume" :: held 2.575s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:49:39 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2b71ba46-1f30-4170-8238-febfc19ae7b4 Jun 04 06:49:39 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:40 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0177539c-98bb-4290-8357-1da8dc50ed6a 1073741824" returned: 0 in 1.111s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0177539c-98bb-4290-8357-1da8dc50ed6a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:40 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ec8468dd-bd08-4747-ba1d-6a7664de0b8c tempest-CreateVolumesFromImageTest-2109098695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2b71ba46-1f30-4170-8238-febfc19ae7b4" returned: 0 in 0.944s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ec8468dd-bd08-4747-ba1d-6a7664de0b8c tempest-CreateVolumesFromImageTest-2109098695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2b71ba46-1f30-4170-8238-febfc19ae7b4 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:40 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0177539c-98bb-4290-8357-1da8dc50ed6a Jun 04 06:49:40 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:40 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2b71ba46-1f30-4170-8238-febfc19ae7b4 Jun 04 06:49:40 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:41 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0177539c-98bb-4290-8357-1da8dc50ed6a" returned: 0 in 0.747s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:41 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] <== create_volume: return (1923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:49:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.926s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.205s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:41 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1771214987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63da0196-7f51-4e3e-83b5-4618adf78b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f711a2128e485fb32f1a1f33792d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:49:29Z,use_quota=True,user_id='839dd26b571d4e16acae6e4adf1cfa99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:49:41 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Creating volume 63da0196-7f51-4e3e-83b5-4618adf78b10 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:49:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:41 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:49:41 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:41 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:49:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:41 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:49:41 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:49:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-63da0196-7f51-4e3e-83b5-4618adf78b10 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ec8468dd-bd08-4747-ba1d-6a7664de0b8c tempest-CreateVolumesFromImageTest-2109098695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2b71ba46-1f30-4170-8238-febfc19ae7b4" returned: 0 in 0.760s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:41 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-63da0196-7f51-4e3e-83b5-4618adf78b10 1073741824 Jun 04 06:49:41 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (357474c5-fd64-4947-8a16-69ae33a6da4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0177539c-98bb-4290-8357-1da8dc50ed6a', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c99ee6ef-a1b5-4fa2-9f4b-fbce1175ca24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:41 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ec8468dd-bd08-4747-ba1d-6a7664de0b8c tempest-CreateVolumesFromImageTest-2109098695 None] Lock "cinder-quobyte-2b71ba46-1f30-4170-8238-febfc19ae7b4" released by "delete_volume" :: held 1.782s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:49:41 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Volume volume-0177539c-98bb-4290-8357-1da8dc50ed6a (0177539c-98bb-4290-8357-1da8dc50ed6a): created successfully Jun 04 06:49:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c99ee6ef-a1b5-4fa2-9f4b-fbce1175ca24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:41 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Flow 'volume_create_manager' (efefd061-31f8-443d-935e-893ff3b55ffa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:49:41 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-f35ff6fe-c49e-4113-9750-67188b59df3d tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Created volume successfully. Jun 04 06:49:41 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-ec8468dd-bd08-4747-ba1d-6a7664de0b8c tempest-CreateVolumesFromImageTest-2109098695 None] Created reservations ['553d57e3-1b9f-4176-a79c-f9f80f151d18', '3f34c219-1734-4d44-977e-0124c447cffe', 'c978438c-1df5-49a1-b34b-f987f796e531', 'daa75e6a-15f7-4c2a-a809-5effd5c40ed0'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:49:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ec8468dd-bd08-4747-ba1d-6a7664de0b8c tempest-CreateVolumesFromImageTest-2109098695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ec8468dd-bd08-4747-ba1d-6a7664de0b8c tempest-CreateVolumesFromImageTest-2109098695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:41 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ec8468dd-bd08-4747-ba1d-6a7664de0b8c tempest-CreateVolumesFromImageTest-2109098695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:49:41 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ec8468dd-bd08-4747-ba1d-6a7664de0b8c tempest-CreateVolumesFromImageTest-2109098695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:49:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ec8468dd-bd08-4747-ba1d-6a7664de0b8c tempest-CreateVolumesFromImageTest-2109098695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ec8468dd-bd08-4747-ba1d-6a7664de0b8c tempest-CreateVolumesFromImageTest-2109098695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:41 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:49:41 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:41 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ebadfbaf-ad5c-4f99-b2bd-41ebc3c0fd6f tempest-CreateVolumesFromImageTest-2109098695 None] Acquiring lock "cinder-07a0da3a-f317-43ee-aa34-661724a02c77-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:41 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ebadfbaf-ad5c-4f99-b2bd-41ebc3c0fd6f tempest-CreateVolumesFromImageTest-2109098695 None] Lock "cinder-07a0da3a-f317-43ee-aa34-661724a02c77-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:41 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ebadfbaf-ad5c-4f99-b2bd-41ebc3c0fd6f tempest-CreateVolumesFromImageTest-2109098695 None] Acquiring lock "cinder-quobyte-07a0da3a-f317-43ee-aa34-661724a02c77" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:41 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ebadfbaf-ad5c-4f99-b2bd-41ebc3c0fd6f tempest-CreateVolumesFromImageTest-2109098695 None] Lock "cinder-quobyte-07a0da3a-f317-43ee-aa34-661724a02c77" acquired by "delete_volume" :: waited 0.029s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:41 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab6378f-ee92-40f4-ab13-600db413beb9]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:49:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ebadfbaf-ad5c-4f99-b2bd-41ebc3c0fd6f tempest-CreateVolumesFromImageTest-2109098695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-07a0da3a-f317-43ee-aa34-661724a02c77 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:41 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-07a0da3a-f317-43ee-aa34-661724a02c77 Jun 04 06:49:41 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:42 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-63da0196-7f51-4e3e-83b5-4618adf78b10 1073741824" returned: 0 in 1.207s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:42 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ec8468dd-bd08-4747-ba1d-6a7664de0b8c tempest-CreateVolumesFromImageTest-2109098695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.021s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:42 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-ec8468dd-bd08-4747-ba1d-6a7664de0b8c tempest-CreateVolumesFromImageTest-2109098695 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:49:42 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-ec8468dd-bd08-4747-ba1d-6a7664de0b8c tempest-CreateVolumesFromImageTest-2109098695 None] Deleted volume successfully. Jun 04 06:49:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-63da0196-7f51-4e3e-83b5-4618adf78b10 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:42 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ec8468dd-bd08-4747-ba1d-6a7664de0b8c tempest-CreateVolumesFromImageTest-2109098695 None] Lock "cinder-2b71ba46-1f30-4170-8238-febfc19ae7b4-delete_volume" released by "delete_volume" :: held 3.123s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:49:42 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-63da0196-7f51-4e3e-83b5-4618adf78b10 Jun 04 06:49:42 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:42 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ebadfbaf-ad5c-4f99-b2bd-41ebc3c0fd6f tempest-CreateVolumesFromImageTest-2109098695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-07a0da3a-f317-43ee-aa34-661724a02c77" returned: 0 in 0.994s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ebadfbaf-ad5c-4f99-b2bd-41ebc3c0fd6f tempest-CreateVolumesFromImageTest-2109098695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-07a0da3a-f317-43ee-aa34-661724a02c77 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:42 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-07a0da3a-f317-43ee-aa34-661724a02c77 Jun 04 06:49:42 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:43 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-63da0196-7f51-4e3e-83b5-4618adf78b10" returned: 0 in 0.728s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:43 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] <== create_volume: return (2004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:49:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.730s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:43 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c708ad85-c23b-47f2-b443-b17da0e2e47f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e89a7bd5ea3b4dd4a1c66f98c4da9137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:49:28Z,use_quota=True,user_id='90b9f7a11f5e407e822eeb5718bc3453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98516ab-8da6-4eec-b029-f4cdb3b55278),volume_type_id=d98516ab-8da6-4eec-b029-f4cdb3b55278)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:49:43 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Creating volume c708ad85-c23b-47f2-b443-b17da0e2e47f {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:49:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:43 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:49:43 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:49:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:43 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:49:43 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:49:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c708ad85-c23b-47f2-b443-b17da0e2e47f 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:43 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a96aa1ce-6e7f-44f4-b64c-ba7a8a110ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63da0196-7f51-4e3e-83b5-4618adf78b10', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:43 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c708ad85-c23b-47f2-b443-b17da0e2e47f 1073741824 Jun 04 06:49:43 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:43 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4b849dc-1950-44c9-b0ac-fb56a4e56600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:43 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Volume volume-63da0196-7f51-4e3e-83b5-4618adf78b10 (63da0196-7f51-4e3e-83b5-4618adf78b10): created successfully Jun 04 06:49:43 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4b849dc-1950-44c9-b0ac-fb56a4e56600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:43 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Flow 'volume_create_manager' (1707366b-fb4c-476f-8971-c28eb7ab5da0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:49:43 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-c074c46b-db0f-478e-ab93-d756f865811e tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Created volume successfully. Jun 04 06:49:43 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ebadfbaf-ad5c-4f99-b2bd-41ebc3c0fd6f tempest-CreateVolumesFromImageTest-2109098695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-07a0da3a-f317-43ee-aa34-661724a02c77" returned: 0 in 0.779s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:43 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ebadfbaf-ad5c-4f99-b2bd-41ebc3c0fd6f tempest-CreateVolumesFromImageTest-2109098695 None] Lock "cinder-quobyte-07a0da3a-f317-43ee-aa34-661724a02c77" released by "delete_volume" :: held 1.828s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:49:43 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-ebadfbaf-ad5c-4f99-b2bd-41ebc3c0fd6f tempest-CreateVolumesFromImageTest-2109098695 None] Created reservations ['5ec71628-d61f-492e-9de5-9e3ded9c8f6b', '5840988d-aa59-4e26-8f10-6fb1b6831ef6', '64a8dd3b-b0bd-490c-92ee-dd69456497f8', '79ec2bf3-3117-40fb-a152-ee8594b231bb'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:49:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ebadfbaf-ad5c-4f99-b2bd-41ebc3c0fd6f tempest-CreateVolumesFromImageTest-2109098695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ebadfbaf-ad5c-4f99-b2bd-41ebc3c0fd6f tempest-CreateVolumesFromImageTest-2109098695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:43 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ebadfbaf-ad5c-4f99-b2bd-41ebc3c0fd6f tempest-CreateVolumesFromImageTest-2109098695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:49:43 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ebadfbaf-ad5c-4f99-b2bd-41ebc3c0fd6f tempest-CreateVolumesFromImageTest-2109098695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:49:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ebadfbaf-ad5c-4f99-b2bd-41ebc3c0fd6f tempest-CreateVolumesFromImageTest-2109098695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ebadfbaf-ad5c-4f99-b2bd-41ebc3c0fd6f tempest-CreateVolumesFromImageTest-2109098695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:43 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:49:43 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:43 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-3a45f1aa-8e99-4548-8640-22b9f5b12e3c tempest-CreateVolumesFromImageTest-2109098695 None] Acquiring lock "cinder-0ae7c388-453c-4fd1-91f9-ac6e988d8ea0-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:43 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-3a45f1aa-8e99-4548-8640-22b9f5b12e3c tempest-CreateVolumesFromImageTest-2109098695 None] Lock "cinder-0ae7c388-453c-4fd1-91f9-ac6e988d8ea0-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:44 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-3a45f1aa-8e99-4548-8640-22b9f5b12e3c tempest-CreateVolumesFromImageTest-2109098695 None] Acquiring lock "cinder-quobyte-0ae7c388-453c-4fd1-91f9-ac6e988d8ea0" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:44 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-3a45f1aa-8e99-4548-8640-22b9f5b12e3c tempest-CreateVolumesFromImageTest-2109098695 None] Lock "cinder-quobyte-0ae7c388-453c-4fd1-91f9-ac6e988d8ea0" acquired by "delete_volume" :: waited 0.023s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:44 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bba5699-e40f-490b-8cd8-6d8a79df80dc]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:49:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3a45f1aa-8e99-4548-8640-22b9f5b12e3c tempest-CreateVolumesFromImageTest-2109098695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0ae7c388-453c-4fd1-91f9-ac6e988d8ea0 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:44 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-b87be273-d6c5-4db7-92ba-9d9b3ce08a56 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Acquiring lock "cinder-63da0196-7f51-4e3e-83b5-4618adf78b10-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:44 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-b87be273-d6c5-4db7-92ba-9d9b3ce08a56 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "cinder-63da0196-7f51-4e3e-83b5-4618adf78b10-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:44 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0ae7c388-453c-4fd1-91f9-ac6e988d8ea0 Jun 04 06:49:44 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:44 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:44 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-b87be273-d6c5-4db7-92ba-9d9b3ce08a56 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Acquiring lock "cinder-quobyte-63da0196-7f51-4e3e-83b5-4618adf78b10" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c708ad85-c23b-47f2-b443-b17da0e2e47f 1073741824" returned: 0 in 1.332s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:44 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-b87be273-d6c5-4db7-92ba-9d9b3ce08a56 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "cinder-quobyte-63da0196-7f51-4e3e-83b5-4618adf78b10" acquired by "delete_volume" :: waited 0.036s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c708ad85-c23b-47f2-b443-b17da0e2e47f {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:44 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba49d47-4047-4fb2-938d-931796693bad]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:49:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b87be273-d6c5-4db7-92ba-9d9b3ce08a56 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-63da0196-7f51-4e3e-83b5-4618adf78b10 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:44 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c708ad85-c23b-47f2-b443-b17da0e2e47f Jun 04 06:49:44 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:44 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ebadfbaf-ad5c-4f99-b2bd-41ebc3c0fd6f tempest-CreateVolumesFromImageTest-2109098695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.940s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:44 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-ebadfbaf-ad5c-4f99-b2bd-41ebc3c0fd6f tempest-CreateVolumesFromImageTest-2109098695 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:49:44 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-ebadfbaf-ad5c-4f99-b2bd-41ebc3c0fd6f tempest-CreateVolumesFromImageTest-2109098695 None] Deleted volume successfully. Jun 04 06:49:44 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ebadfbaf-ad5c-4f99-b2bd-41ebc3c0fd6f tempest-CreateVolumesFromImageTest-2109098695 None] Lock "cinder-07a0da3a-f317-43ee-aa34-661724a02c77-delete_volume" released by "delete_volume" :: held 3.076s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:49:44 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-63da0196-7f51-4e3e-83b5-4618adf78b10 Jun 04 06:49:44 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:45 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3a45f1aa-8e99-4548-8640-22b9f5b12e3c tempest-CreateVolumesFromImageTest-2109098695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0ae7c388-453c-4fd1-91f9-ac6e988d8ea0" returned: 0 in 0.956s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3a45f1aa-8e99-4548-8640-22b9f5b12e3c tempest-CreateVolumesFromImageTest-2109098695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0ae7c388-453c-4fd1-91f9-ac6e988d8ea0 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:45 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0ae7c388-453c-4fd1-91f9-ac6e988d8ea0 Jun 04 06:49:45 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:45 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c708ad85-c23b-47f2-b443-b17da0e2e47f" returned: 0 in 0.756s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] <== create_volume: return (2168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.173s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG cinder.volume.volume_utils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Attempting download of 9bd586b1-3435-44f9-aa60-a97c0eb713c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/9bd586b1-3435-44f9-aa60-a97c0eb713c6', 'metadata': {}}])) to volume c708ad85-c23b-47f2-b443-b17da0e2e47f. {{(pid=86069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] Flow 'volume_create_manager' (13083616-42d7-4b45-b42c-f05e4eeb4042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (122a7e76-7e58-48f5-bb29-4de63c5d5eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:45 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (122a7e76-7e58-48f5-bb29-4de63c5d5eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-407509629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcfe8eff2a30433691a00d810eaa3912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:49:45Z,use_quota=True,user_id='7c6918209a1b4db78989681a0f5bd598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9127513-3ceb-46bb-9e8f-185e6a558482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9127513-3ceb-46bb-9e8f-185e6a558482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b2b3b9e-1671-4403-a714-300ea5aaee1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b2b3b9e-1671-4403-a714-300ea5aaee1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726', 'volume_name': 'volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481e2607-981d-4597-b763-bb8a15af03c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481e2607-981d-4597-b763-bb8a15af03c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0967de0-866d-4852-a3e1-f388e68737c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:45 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] Volume cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726', 'volume_size': 1} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-407509629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcfe8eff2a30433691a00d810eaa3912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:49:45Z,use_quota=True,user_id='7c6918209a1b4db78989681a0f5bd598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] Creating volume cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:49:45 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b87be273-d6c5-4db7-92ba-9d9b3ce08a56 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-63da0196-7f51-4e3e-83b5-4618adf78b10" returned: 0 in 0.921s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b87be273-d6c5-4db7-92ba-9d9b3ce08a56 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-63da0196-7f51-4e3e-83b5-4618adf78b10 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:45 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726 1073741824 Jun 04 06:49:45 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[969053c8-bff4-47fa-a828-73365bbfa1b9]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bd586b1-3435-44f9-aa60-a97c0eb713c6_9521dwwm {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:45 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-63da0196-7f51-4e3e-83b5-4618adf78b10 Jun 04 06:49:45 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:45 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bd586b1-3435-44f9-aa60-a97c0eb713c6_9521dwwm Jun 04 06:49:45 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:45 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3a45f1aa-8e99-4548-8640-22b9f5b12e3c tempest-CreateVolumesFromImageTest-2109098695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0ae7c388-453c-4fd1-91f9-ac6e988d8ea0" returned: 0 in 0.731s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-3a45f1aa-8e99-4548-8640-22b9f5b12e3c tempest-CreateVolumesFromImageTest-2109098695 None] Lock "cinder-quobyte-0ae7c388-453c-4fd1-91f9-ac6e988d8ea0" released by "delete_volume" :: held 1.773s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-3a45f1aa-8e99-4548-8640-22b9f5b12e3c tempest-CreateVolumesFromImageTest-2109098695 None] Created reservations ['cac991ad-f1c9-4075-8a08-c8de46c1e5f9', '8f9c2048-8aa8-4c6f-b7ca-0fe331f3cc8b', '4277725f-1125-4dca-b6d5-399f1107fdae', 'a83311f5-6400-42a3-a26d-50c8fe72c5b9'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-3a45f1aa-8e99-4548-8640-22b9f5b12e3c tempest-CreateVolumesFromImageTest-2109098695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-3a45f1aa-8e99-4548-8640-22b9f5b12e3c tempest-CreateVolumesFromImageTest-2109098695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-3a45f1aa-8e99-4548-8640-22b9f5b12e3c tempest-CreateVolumesFromImageTest-2109098695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-3a45f1aa-8e99-4548-8640-22b9f5b12e3c tempest-CreateVolumesFromImageTest-2109098695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-3a45f1aa-8e99-4548-8640-22b9f5b12e3c tempest-CreateVolumesFromImageTest-2109098695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3a45f1aa-8e99-4548-8640-22b9f5b12e3c tempest-CreateVolumesFromImageTest-2109098695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:46 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:49:46 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:46 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b87be273-d6c5-4db7-92ba-9d9b3ce08a56 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-63da0196-7f51-4e3e-83b5-4618adf78b10" returned: 0 in 0.618s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:46 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-b87be273-d6c5-4db7-92ba-9d9b3ce08a56 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "cinder-quobyte-63da0196-7f51-4e3e-83b5-4618adf78b10" released by "delete_volume" :: held 1.615s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:49:46 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-b87be273-d6c5-4db7-92ba-9d9b3ce08a56 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Created reservations ['21a9139a-b9c5-434f-9d4c-953ac5059f89', 'f97f3a0c-5537-44fd-a266-7a9e60a37c5e', '2f2d419b-35ea-4acb-94ba-0ceeb88dc5ac', 'c2cae08d-a712-4175-bed7-9afca1aa6127'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:49:46 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bd586b1-3435-44f9-aa60-a97c0eb713c6_9521dwwm" returned: 0 in 0.761s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bd586b1-3435-44f9-aa60-a97c0eb713c6_9521dwwm {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-b87be273-d6c5-4db7-92ba-9d9b3ce08a56 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-b87be273-d6c5-4db7-92ba-9d9b3ce08a56 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:46 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-b87be273-d6c5-4db7-92ba-9d9b3ce08a56 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:49:46 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-b87be273-d6c5-4db7-92ba-9d9b3ce08a56 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:49:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-b87be273-d6c5-4db7-92ba-9d9b3ce08a56 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b87be273-d6c5-4db7-92ba-9d9b3ce08a56 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:46 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:49:46 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:46 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bd586b1-3435-44f9-aa60-a97c0eb713c6_9521dwwm Jun 04 06:49:46 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:46 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726 1073741824" returned: 0 in 0.999s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:46 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726 Jun 04 06:49:46 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:46 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-356cf39c-2e17-490a-a37e-9b7786669481 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Acquiring lock "cinder-0177539c-98bb-4290-8357-1da8dc50ed6a-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:46 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-356cf39c-2e17-490a-a37e-9b7786669481 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "cinder-0177539c-98bb-4290-8357-1da8dc50ed6a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:46 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-356cf39c-2e17-490a-a37e-9b7786669481 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Acquiring lock "cinder-quobyte-0177539c-98bb-4290-8357-1da8dc50ed6a" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:46 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-356cf39c-2e17-490a-a37e-9b7786669481 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "cinder-quobyte-0177539c-98bb-4290-8357-1da8dc50ed6a" acquired by "delete_volume" :: waited 0.028s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:46 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9e8ebe-35dc-4a02-965d-feee2257bd57]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:49:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-356cf39c-2e17-490a-a37e-9b7786669481 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0177539c-98bb-4290-8357-1da8dc50ed6a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:46 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0177539c-98bb-4290-8357-1da8dc50ed6a Jun 04 06:49:46 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:46 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-3a45f1aa-8e99-4548-8640-22b9f5b12e3c tempest-CreateVolumesFromImageTest-2109098695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.001s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:46 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-3a45f1aa-8e99-4548-8640-22b9f5b12e3c tempest-CreateVolumesFromImageTest-2109098695 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:49:46 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-3a45f1aa-8e99-4548-8640-22b9f5b12e3c tempest-CreateVolumesFromImageTest-2109098695 None] Deleted volume successfully. Jun 04 06:49:47 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-3a45f1aa-8e99-4548-8640-22b9f5b12e3c tempest-CreateVolumesFromImageTest-2109098695 None] Lock "cinder-0ae7c388-453c-4fd1-91f9-ac6e988d8ea0-delete_volume" released by "delete_volume" :: held 3.070s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:49:47 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-b87be273-d6c5-4db7-92ba-9d9b3ce08a56 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.965s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:47 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-b87be273-d6c5-4db7-92ba-9d9b3ce08a56 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:49:47 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-b87be273-d6c5-4db7-92ba-9d9b3ce08a56 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Deleted volume successfully. Jun 04 06:49:47 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-b87be273-d6c5-4db7-92ba-9d9b3ce08a56 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "cinder-63da0196-7f51-4e3e-83b5-4618adf78b10-delete_volume" released by "delete_volume" :: held 2.914s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:49:47 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bd586b1-3435-44f9-aa60-a97c0eb713c6_9521dwwm" returned: 1 in 1.176s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bd586b1-3435-44f9-aa60-a97c0eb713c6_9521dwwm' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:49:47 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5fa274-5e16-4c33-b7da-3b0eff475ecc]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:49:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd586b1-3435-44f9-aa60-a97c0eb713c6_salh8ihmdevstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:47 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726" returned: 0 in 1.033s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:47 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] <== create_volume: return (2103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:49:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.106s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:47 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd586b1-3435-44f9-aa60-a97c0eb713c6_salh8ihmdevstack@QuobyteHD Jun 04 06:49:47 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0967de0-866d-4852-a3e1-f388e68737c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc2478a-ee01-43b3-882a-52941db05259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:47 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] Volume volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726 (cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726): created successfully Jun 04 06:49:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc2478a-ee01-43b3-882a-52941db05259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:47 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] Flow 'volume_create_manager' (13083616-42d7-4b45-b42c-f05e4eeb4042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:49:47 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-7e5afeae-4c7c-4f43-97ae-3ae9630bfdc1 tempest-SnapshotDependencyTests-1971429625 None] Created volume successfully. Jun 04 06:49:47 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-356cf39c-2e17-490a-a37e-9b7786669481 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0177539c-98bb-4290-8357-1da8dc50ed6a" returned: 0 in 0.923s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-356cf39c-2e17-490a-a37e-9b7786669481 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0177539c-98bb-4290-8357-1da8dc50ed6a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:47 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0177539c-98bb-4290-8357-1da8dc50ed6a Jun 04 06:49:47 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:48 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd586b1-3435-44f9-aa60-a97c0eb713c6_salh8ihmdevstack@QuobyteHD" returned: 0 in 0.712s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd586b1-3435-44f9-aa60-a97c0eb713c6_salh8ihmdevstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:48 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd586b1-3435-44f9-aa60-a97c0eb713c6_salh8ihmdevstack@QuobyteHD Jun 04 06:49:48 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:48 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-356cf39c-2e17-490a-a37e-9b7786669481 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-0177539c-98bb-4290-8357-1da8dc50ed6a" returned: 0 in 0.702s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:48 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-356cf39c-2e17-490a-a37e-9b7786669481 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "cinder-quobyte-0177539c-98bb-4290-8357-1da8dc50ed6a" released by "delete_volume" :: held 1.684s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:49:48 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-356cf39c-2e17-490a-a37e-9b7786669481 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Created reservations ['06865d31-9004-48a2-a827-ab0a1ea4fac1', '586ba5c1-6cf7-44e8-b685-41c04bd13fbb', '36c35cde-323d-480b-8845-f11cc89f607b', 'cd012f68-37c4-4bcd-ac98-addc1b0fcb6c'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:49:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-356cf39c-2e17-490a-a37e-9b7786669481 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-356cf39c-2e17-490a-a37e-9b7786669481 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:48 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-356cf39c-2e17-490a-a37e-9b7786669481 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:49:48 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-356cf39c-2e17-490a-a37e-9b7786669481 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:49:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-356cf39c-2e17-490a-a37e-9b7786669481 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-356cf39c-2e17-490a-a37e-9b7786669481 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:48 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:49:48 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-1bab3c61-09d2-4955-9b2d-05262f347f7f tempest-SnapshotDependencyTests-1971429625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-1bab3c61-09d2-4955-9b2d-05262f347f7f tempest-SnapshotDependencyTests-1971429625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:48 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-1bab3c61-09d2-4955-9b2d-05262f347f7f tempest-SnapshotDependencyTests-1971429625 None] Creating offline snapshot 91e098e0-15cd-4af1-8fad-e808e239647c of volume cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726 {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:49:48 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd586b1-3435-44f9-aa60-a97c0eb713c6_salh8ihmdevstack@QuobyteHD" returned: 1 in 0.753s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bd586b1-3435-44f9-aa60-a97c0eb713c6_salh8ihmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:49:48 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] 9bd586b1-3435-44f9-aa60-a97c0eb713c6 was raw, converting to raw {{(pid=86069) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 04 06:49:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9bd586b1-3435-44f9-aa60-a97c0eb713c6_salh8ihmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c708ad85-c23b-47f2-b443-b17da0e2e47f {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:48 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c502e7-d709-4722-8798-88f6066ce499]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:49:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1bab3c61-09d2-4955-9b2d-05262f347f7f tempest-SnapshotDependencyTests-1971429625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:48 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9bd586b1-3435-44f9-aa60-a97c0eb713c6_salh8ihmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c708ad85-c23b-47f2-b443-b17da0e2e47f Jun 04 06:49:48 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:48 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-5b26a37f-6143-490c-9c04-caf39274d1db tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Acquiring lock "cinder-122c4caa-c0d3-4db4-bf13-fb7c625abd3c-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:48 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-5b26a37f-6143-490c-9c04-caf39274d1db tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "cinder-122c4caa-c0d3-4db4-bf13-fb7c625abd3c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:48 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-5b26a37f-6143-490c-9c04-caf39274d1db tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Acquiring lock "cinder-quobyte-122c4caa-c0d3-4db4-bf13-fb7c625abd3c" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:49 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-5b26a37f-6143-490c-9c04-caf39274d1db tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "cinder-quobyte-122c4caa-c0d3-4db4-bf13-fb7c625abd3c" acquired by "delete_volume" :: waited 0.030s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:49 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726 Jun 04 06:49:49 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:49 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5707f5-321f-493d-9b5a-df4148c58a40]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:49:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5b26a37f-6143-490c-9c04-caf39274d1db tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-122c4caa-c0d3-4db4-bf13-fb7c625abd3c {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:49 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-122c4caa-c0d3-4db4-bf13-fb7c625abd3c Jun 04 06:49:49 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:49 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-356cf39c-2e17-490a-a37e-9b7786669481 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.997s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:49 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-356cf39c-2e17-490a-a37e-9b7786669481 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:49:49 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-356cf39c-2e17-490a-a37e-9b7786669481 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Deleted volume successfully. Jun 04 06:49:49 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-356cf39c-2e17-490a-a37e-9b7786669481 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "cinder-0177539c-98bb-4290-8357-1da8dc50ed6a-delete_volume" released by "delete_volume" :: held 3.032s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:49:49 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9bd586b1-3435-44f9-aa60-a97c0eb713c6_salh8ihmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c708ad85-c23b-47f2-b443-b17da0e2e47f" returned: 0 in 0.904s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:49 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9bd586b1-3435-44f9-aa60-a97c0eb713c6_salh8ihmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c708ad85-c23b-47f2-b443-b17da0e2e47f {{(pid=86069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 06:49:49 devstack cinder-volume[86069]: INFO cinder.image.image_utils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Converted 0.00 MB image at 0.00 MB/s Jun 04 06:49:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c708ad85-c23b-47f2-b443-b17da0e2e47f 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:49 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c708ad85-c23b-47f2-b443-b17da0e2e47f 1G Jun 04 06:49:49 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:49 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1bab3c61-09d2-4955-9b2d-05262f347f7f tempest-SnapshotDependencyTests-1971429625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726" returned: 0 in 0.982s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1bab3c61-09d2-4955-9b2d-05262f347f7f tempest-SnapshotDependencyTests-1971429625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726.91e098e0-15cd-4af1-8fad-e808e239647c 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:49 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726.91e098e0-15cd-4af1-8fad-e808e239647c 1G Jun 04 06:49:49 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:49 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5b26a37f-6143-490c-9c04-caf39274d1db tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-122c4caa-c0d3-4db4-bf13-fb7c625abd3c" returned: 0 in 0.880s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5b26a37f-6143-490c-9c04-caf39274d1db tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-122c4caa-c0d3-4db4-bf13-fb7c625abd3c {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:50 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-122c4caa-c0d3-4db4-bf13-fb7c625abd3c Jun 04 06:49:50 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:50 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:49:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] Flow 'volume_create_manager' (43dddd37-a300-44e2-a175-b409b894b044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:49:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8805e013-e432-48d6-830c-8d3b606f66a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8805e013-e432-48d6-830c-8d3b606f66a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1740572954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98a465f4-6017-43b4-8760-4bf7380d4ece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='737e3986fade4a90ad7d6eec4d996363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:49:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:49:50Z,use_quota=True,user_id='54d445e2be3f4449bea50de938d6b590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7677ae32-4f62-4308-8e51-cbeedc8c1c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7677ae32-4f62-4308-8e51-cbeedc8c1c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6970712e-0b82-4bf3-9a83-268040cf0184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6970712e-0b82-4bf3-9a83-268040cf0184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98a465f4-6017-43b4-8760-4bf7380d4ece', 'volume_name': 'volume-98a465f4-6017-43b4-8760-4bf7380d4ece', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47de06ab-8198-45ad-916f-07e2bc8ce28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47de06ab-8198-45ad-916f-07e2bc8ce28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:50 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67393d1c-ecff-42cf-8bb7-a50cdf6b5e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:50 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] Volume 98a465f4-6017-43b4-8760-4bf7380d4ece: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98a465f4-6017-43b4-8760-4bf7380d4ece', 'volume_size': 1} Jun 04 06:49:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:50 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c708ad85-c23b-47f2-b443-b17da0e2e47f 1G" returned: 0 in 0.763s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:50 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cac6870-5523-4126-a834-711b6214e21b]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:49:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c708ad85-c23b-47f2-b443-b17da0e2e47f {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:50 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c708ad85-c23b-47f2-b443-b17da0e2e47f Jun 04 06:49:50 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:50 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5b26a37f-6143-490c-9c04-caf39274d1db tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-122c4caa-c0d3-4db4-bf13-fb7c625abd3c" returned: 0 in 0.806s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:50 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-5b26a37f-6143-490c-9c04-caf39274d1db tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "cinder-quobyte-122c4caa-c0d3-4db4-bf13-fb7c625abd3c" released by "delete_volume" :: held 1.767s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:49:50 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1bab3c61-09d2-4955-9b2d-05262f347f7f tempest-SnapshotDependencyTests-1971429625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726.91e098e0-15cd-4af1-8fad-e808e239647c 1G" returned: 0 in 0.986s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1bab3c61-09d2-4955-9b2d-05262f347f7f tempest-SnapshotDependencyTests-1971429625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726.91e098e0-15cd-4af1-8fad-e808e239647c {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:50 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726.91e098e0-15cd-4af1-8fad-e808e239647c Jun 04 06:49:50 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:50 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-5b26a37f-6143-490c-9c04-caf39274d1db tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Created reservations ['fbcebd65-26f1-42c3-b6e0-df2ef7350e47', 'bf635a52-4c55-451e-911e-825c8d120511', 'afbc8a9f-3d67-4e73-9187-90e99b6f541f', 'fcfe263d-dcda-471e-b624-737ce5079c9b'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:49:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5b26a37f-6143-490c-9c04-caf39274d1db tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5b26a37f-6143-490c-9c04-caf39274d1db tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:50 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5b26a37f-6143-490c-9c04-caf39274d1db tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:49:50 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5b26a37f-6143-490c-9c04-caf39274d1db tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:49:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5b26a37f-6143-490c-9c04-caf39274d1db tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5b26a37f-6143-490c-9c04-caf39274d1db tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:50 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:49:50 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:51 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ecb69e99-2e26-45c9-9cf6-00b992ccb648 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Acquiring lock "cinder-f620ca5d-8ba8-4de1-b296-35d26d42e7b8-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:51 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ecb69e99-2e26-45c9-9cf6-00b992ccb648 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "cinder-f620ca5d-8ba8-4de1-b296-35d26d42e7b8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:51 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ecb69e99-2e26-45c9-9cf6-00b992ccb648 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Acquiring lock "cinder-quobyte-f620ca5d-8ba8-4de1-b296-35d26d42e7b8" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:51 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ecb69e99-2e26-45c9-9cf6-00b992ccb648 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "cinder-quobyte-f620ca5d-8ba8-4de1-b296-35d26d42e7b8" acquired by "delete_volume" :: waited 0.022s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:51 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c708ad85-c23b-47f2-b443-b17da0e2e47f" returned: 0 in 0.861s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c708ad85-c23b-47f2-b443-b17da0e2e47f {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:51 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c01da7-54f5-429c-9b78-e4a545c2bb86]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:49:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ecb69e99-2e26-45c9-9cf6-00b992ccb648 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f620ca5d-8ba8-4de1-b296-35d26d42e7b8 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:51 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c708ad85-c23b-47f2-b443-b17da0e2e47f Jun 04 06:49:51 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:51 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f620ca5d-8ba8-4de1-b296-35d26d42e7b8 Jun 04 06:49:51 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:51 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1bab3c61-09d2-4955-9b2d-05262f347f7f tempest-SnapshotDependencyTests-1971429625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726.91e098e0-15cd-4af1-8fad-e808e239647c" returned: 0 in 0.727s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:51 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-1bab3c61-09d2-4955-9b2d-05262f347f7f tempest-SnapshotDependencyTests-1971429625 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726.91e098e0-15cd-4af1-8fad-e808e239647c is being set with open permissions: ugo+rw Jun 04 06:49:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1bab3c61-09d2-4955-9b2d-05262f347f7f tempest-SnapshotDependencyTests-1971429625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726.91e098e0-15cd-4af1-8fad-e808e239647c {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:51 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726.91e098e0-15cd-4af1-8fad-e808e239647c Jun 04 06:49:51 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:51 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5b26a37f-6143-490c-9c04-caf39274d1db tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.728s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:51 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-5b26a37f-6143-490c-9c04-caf39274d1db tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:49:51 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-5b26a37f-6143-490c-9c04-caf39274d1db tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Deleted volume successfully. Jun 04 06:49:51 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-5b26a37f-6143-490c-9c04-caf39274d1db tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "cinder-122c4caa-c0d3-4db4-bf13-fb7c625abd3c-delete_volume" released by "delete_volume" :: held 2.766s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:49:52 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c708ad85-c23b-47f2-b443-b17da0e2e47f" returned: 1 in 0.739s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c708ad85-c23b-47f2-b443-b17da0e2e47f' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:49:52 devstack cinder-volume[86069]: DEBUG cinder.volume.volume_utils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Downloaded image 9bd586b1-3435-44f9-aa60-a97c0eb713c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/9bd586b1-3435-44f9-aa60-a97c0eb713c6', 'metadata': {}}])) to volume c708ad85-c23b-47f2-b443-b17da0e2e47f successfully. {{(pid=86069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 04 06:49:52 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Temporary image 9bd586b1-3435-44f9-aa60-a97c0eb713c6 for user 90b9f7a11f5e407e822eeb5718bc3453 is deleted. {{(pid=86069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 04 06:49:52 devstack cinder-volume[86069]: DEBUG cinder.volume.volume_utils [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Marking volume c708ad85-c23b-47f2-b443-b17da0e2e47f as bootable. {{(pid=86069) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 04 06:49:52 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Copying metadata from image 9bd586b1-3435-44f9-aa60-a97c0eb713c6 to c708ad85-c23b-47f2-b443-b17da0e2e47f. {{(pid=86069) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 04 06:49:52 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Creating volume glance metadata for volume c708ad85-c23b-47f2-b443-b17da0e2e47f backed by image 9bd586b1-3435-44f9-aa60-a97c0eb713c6 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '9bd586b1-3435-44f9-aa60-a97c0eb713c6', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5f3c6e4b58ab27fa4635c1e7c155be97', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86069) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 04 06:49:52 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ecb69e99-2e26-45c9-9cf6-00b992ccb648 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f620ca5d-8ba8-4de1-b296-35d26d42e7b8" returned: 0 in 0.755s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ecb69e99-2e26-45c9-9cf6-00b992ccb648 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f620ca5d-8ba8-4de1-b296-35d26d42e7b8 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:52 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:52 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f620ca5d-8ba8-4de1-b296-35d26d42e7b8 Jun 04 06:49:52 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1bab3c61-09d2-4955-9b2d-05262f347f7f tempest-SnapshotDependencyTests-1971429625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726.91e098e0-15cd-4af1-8fad-e808e239647c" returned: 0 in 0.646s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1bab3c61-09d2-4955-9b2d-05262f347f7f tempest-SnapshotDependencyTests-1971429625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:52 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726.info Jun 04 06:49:52 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:52 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29df2dd4-8a1b-4c9a-8fb4-4e41c4a9b029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c708ad85-c23b-47f2-b443-b17da0e2e47f', 'volume_size': 1, 'image_id': '9bd586b1-3435-44f9-aa60-a97c0eb713c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bd586b1-3435-44f9-aa60-a97c0eb713c6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5f3c6e4b58ab27fa4635c1e7c155be97', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e89a7bd5ea3b4dd4a1c66f98c4da9137', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '261dccba788a554aa54aa1d568e2e7406ccaa4d5c8416a28cd5c7ed0f1a7a97a09a3dde3b873ff821898870319b4114c9c745ccb1c5ab6ea368fd97ec46df4a6', 'id': '9bd586b1-3435-44f9-aa60-a97c0eb713c6', 'created_at': datetime.datetime(2026, 6, 4, 4, 49, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 4, 49, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bd586b1-3435-44f9-aa60-a97c0eb713c6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:52 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (870dd4cc-69bf-4930-be0d-d897ce739e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:52 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Volume volume-c708ad85-c23b-47f2-b443-b17da0e2e47f (c708ad85-c23b-47f2-b443-b17da0e2e47f): created successfully Jun 04 06:49:52 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (870dd4cc-69bf-4930-be0d-d897ce739e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:52 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Flow 'volume_create_manager' (e4b8aeea-2972-44d6-ab15-ef82a650b2d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:49:52 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-1aa1e924-7bf1-4e94-9ecd-ed8ab5862175 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Created volume successfully. Jun 04 06:49:52 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ecb69e99-2e26-45c9-9cf6-00b992ccb648 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f620ca5d-8ba8-4de1-b296-35d26d42e7b8" returned: 0 in 0.587s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:52 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ecb69e99-2e26-45c9-9cf6-00b992ccb648 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "cinder-quobyte-f620ca5d-8ba8-4de1-b296-35d26d42e7b8" released by "delete_volume" :: held 1.386s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:49:52 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-ecb69e99-2e26-45c9-9cf6-00b992ccb648 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Created reservations ['50519b65-99a8-4a53-9ede-031ebf5cbabc', '95bc6e85-8483-4b64-8d0e-20ce6e93c44b', 'b989db95-1998-4708-b16c-c4b5ac45eca6', '48fd6a27-81ff-4b3e-9455-ac686179be98'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:49:52 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1bab3c61-09d2-4955-9b2d-05262f347f7f tempest-SnapshotDependencyTests-1971429625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726.info" returned: 0 in 0.588s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:52 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-1bab3c61-09d2-4955-9b2d-05262f347f7f tempest-SnapshotDependencyTests-1971429625 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726.info is being set with open permissions: ugo+rw Jun 04 06:49:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1bab3c61-09d2-4955-9b2d-05262f347f7f tempest-SnapshotDependencyTests-1971429625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:52 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726.info Jun 04 06:49:52 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ecb69e99-2e26-45c9-9cf6-00b992ccb648 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ecb69e99-2e26-45c9-9cf6-00b992ccb648 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:52 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ecb69e99-2e26-45c9-9cf6-00b992ccb648 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:49:52 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ecb69e99-2e26-45c9-9cf6-00b992ccb648 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:49:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ecb69e99-2e26-45c9-9cf6-00b992ccb648 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ecb69e99-2e26-45c9-9cf6-00b992ccb648 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:52 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:49:52 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:53 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-96c051be-a12b-4d5f-bbf6-6d62c2e486b8 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Acquiring lock "cinder-c708ad85-c23b-47f2-b443-b17da0e2e47f-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:53 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-96c051be-a12b-4d5f-bbf6-6d62c2e486b8 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Lock "cinder-c708ad85-c23b-47f2-b443-b17da0e2e47f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:53 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-96c051be-a12b-4d5f-bbf6-6d62c2e486b8 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Acquiring lock "cinder-quobyte-c708ad85-c23b-47f2-b443-b17da0e2e47f" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:53 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-96c051be-a12b-4d5f-bbf6-6d62c2e486b8 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Lock "cinder-quobyte-c708ad85-c23b-47f2-b443-b17da0e2e47f" acquired by "delete_volume" :: waited 0.025s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:53 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c4655b-7e19-4531-97b1-4646b804f6e9]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:49:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-96c051be-a12b-4d5f-bbf6-6d62c2e486b8 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c708ad85-c23b-47f2-b443-b17da0e2e47f {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:53 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c708ad85-c23b-47f2-b443-b17da0e2e47f Jun 04 06:49:53 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:53 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1bab3c61-09d2-4955-9b2d-05262f347f7f tempest-SnapshotDependencyTests-1971429625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726.info" returned: 0 in 0.647s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-1bab3c61-09d2-4955-9b2d-05262f347f7f tempest-SnapshotDependencyTests-1971429625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.744s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.154s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:53 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1740572954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98a465f4-6017-43b4-8760-4bf7380d4ece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='737e3986fade4a90ad7d6eec4d996363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:49:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:49:50Z,use_quota=True,user_id='54d445e2be3f4449bea50de938d6b590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:49:53 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] Creating volume 98a465f4-6017-43b4-8760-4bf7380d4ece {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:49:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:53 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:49:53 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:49:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:53 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:49:53 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:49:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:53 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ecb69e99-2e26-45c9-9cf6-00b992ccb648 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.663s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:53 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-ecb69e99-2e26-45c9-9cf6-00b992ccb648 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:49:53 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece 1073741824 Jun 04 06:49:53 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:53 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-44405ef5-c43f-4c23-98fb-f853d2165cf8 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Acquiring lock "cinder-119ae78a-4502-4418-aa1b-05f9ddae2046-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:53 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-ecb69e99-2e26-45c9-9cf6-00b992ccb648 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Deleted volume successfully. Jun 04 06:49:53 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-1bab3c61-09d2-4955-9b2d-05262f347f7f tempest-SnapshotDependencyTests-1971429625 None] Create snapshot completed successfully Jun 04 06:49:53 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ecb69e99-2e26-45c9-9cf6-00b992ccb648 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "cinder-f620ca5d-8ba8-4de1-b296-35d26d42e7b8-delete_volume" released by "delete_volume" :: held 2.314s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:49:53 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-44405ef5-c43f-4c23-98fb-f853d2165cf8 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "cinder-119ae78a-4502-4418-aa1b-05f9ddae2046-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:53 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-44405ef5-c43f-4c23-98fb-f853d2165cf8 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Acquiring lock "cinder-quobyte-119ae78a-4502-4418-aa1b-05f9ddae2046" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:53 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-44405ef5-c43f-4c23-98fb-f853d2165cf8 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "cinder-quobyte-119ae78a-4502-4418-aa1b-05f9ddae2046" acquired by "delete_volume" :: waited 0.021s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:53 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e86151d-c9ac-4e31-a704-264bf20b07c5]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:49:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-44405ef5-c43f-4c23-98fb-f853d2165cf8 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-119ae78a-4502-4418-aa1b-05f9ddae2046 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:53 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-119ae78a-4502-4418-aa1b-05f9ddae2046 Jun 04 06:49:53 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:53 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-96c051be-a12b-4d5f-bbf6-6d62c2e486b8 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c708ad85-c23b-47f2-b443-b17da0e2e47f" returned: 0 in 0.736s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-96c051be-a12b-4d5f-bbf6-6d62c2e486b8 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c708ad85-c23b-47f2-b443-b17da0e2e47f {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:54 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c708ad85-c23b-47f2-b443-b17da0e2e47f Jun 04 06:49:54 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:54 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece 1073741824" returned: 0 in 0.912s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:54 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece Jun 04 06:49:54 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:54 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-44405ef5-c43f-4c23-98fb-f853d2165cf8 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-119ae78a-4502-4418-aa1b-05f9ddae2046" returned: 0 in 0.841s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-44405ef5-c43f-4c23-98fb-f853d2165cf8 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-119ae78a-4502-4418-aa1b-05f9ddae2046 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:54 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-119ae78a-4502-4418-aa1b-05f9ddae2046 Jun 04 06:49:54 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:54 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:49:54 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Flow 'volume_create_manager' (dc720174-fdd2-48d5-a876-f4e9d813f14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:49:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a34165-cc7e-4b0e-b315-8bc2c7c29f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-96c051be-a12b-4d5f-bbf6-6d62c2e486b8 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c708ad85-c23b-47f2-b443-b17da0e2e47f" returned: 1 in 0.841s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-96c051be-a12b-4d5f-bbf6-6d62c2e486b8 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c708ad85-c23b-47f2-b443-b17da0e2e47f' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:49:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-96c051be-a12b-4d5f-bbf6-6d62c2e486b8 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c708ad85-c23b-47f2-b443-b17da0e2e47f {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a34165-cc7e-4b0e-b315-8bc2c7c29f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=093dad15-e10a-452f-b929-aa0f1e826512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcfe8eff2a30433691a00d810eaa3912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=91e098e0-15cd-4af1-8fad-e808e239647c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:49:55Z,use_quota=True,user_id='7c6918209a1b4db78989681a0f5bd598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:54 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c708ad85-c23b-47f2-b443-b17da0e2e47f Jun 04 06:49:54 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd99a52b-4550-4d89-8134-926810195e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd99a52b-4550-4d89-8134-926810195e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b10c69bc-db65-453a-9461-99cca09dcefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b10c69bc-db65-453a-9461-99cca09dcefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '093dad15-e10a-452f-b929-aa0f1e826512', 'volume_name': 'volume-093dad15-e10a-452f-b929-aa0f1e826512', 'volume_size': 1, 'snapshot_id': '91e098e0-15cd-4af1-8fad-e808e239647c'}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3478eab9-fa88-478e-bdfe-f11bd6bd3628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3478eab9-fa88-478e-bdfe-f11bd6bd3628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:54 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d3d49d4-df41-4491-adc9-2d5e9f8fb637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:54 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Volume 093dad15-e10a-452f-b929-aa0f1e826512: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-093dad15-e10a-452f-b929-aa0f1e826512', 'volume_size': 1, 'snapshot_id': '91e098e0-15cd-4af1-8fad-e808e239647c'} Jun 04 06:49:54 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:55 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-44405ef5-c43f-4c23-98fb-f853d2165cf8 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-119ae78a-4502-4418-aa1b-05f9ddae2046" returned: 0 in 0.641s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:55 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-44405ef5-c43f-4c23-98fb-f853d2165cf8 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "cinder-quobyte-119ae78a-4502-4418-aa1b-05f9ddae2046" released by "delete_volume" :: held 1.523s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece" returned: 0 in 0.736s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.343s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Acquiring lock "cinder-quobyte-91e098e0-15cd-4af1-8fad-e808e239647c-093dad15-e10a-452f-b929-aa0f1e826512" by "_create_volume_from_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67393d1c-ecff-42cf-8bb7-a50cdf6b5e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98a465f4-6017-43b4-8760-4bf7380d4ece', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c643d239-e0ee-41ef-b9d2-0b60f2bccad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Lock "cinder-quobyte-91e098e0-15cd-4af1-8fad-e808e239647c-093dad15-e10a-452f-b929-aa0f1e826512" acquired by "_create_volume_from_snapshot" :: waited 0.049s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Creating volume 093dad15-e10a-452f-b929-aa0f1e826512 from snapshot 91e098e0-15cd-4af1-8fad-e808e239647c {{(pid=86069) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Acquiring lock "cinder-quobyte-093dad15-e10a-452f-b929-aa0f1e826512" by "_copy_volume_from_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:55 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] Volume volume-98a465f4-6017-43b4-8760-4bf7380d4ece (98a465f4-6017-43b4-8760-4bf7380d4ece): created successfully Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c643d239-e0ee-41ef-b9d2-0b60f2bccad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] Flow 'volume_create_manager' (43dddd37-a300-44e2-a175-b409b894b044) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Lock "cinder-quobyte-093dad15-e10a-452f-b929-aa0f1e826512" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] snapshot: 91e098e0-15cd-4af1-8fad-e808e239647c, volume: 093dad15-e10a-452f-b929-aa0f1e826512, {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 06:49:55 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-5c598c87-06ba-4c6f-9b58-b177382c0bf5 tempest-VolumeDependencyTests-2006023204 None] Created volume successfully. Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-44405ef5-c43f-4c23-98fb-f853d2165cf8 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Created reservations ['abbe3a80-c83c-4abb-b096-e56d5ba3e51f', '166b3500-5d60-4a81-85eb-477826b2a197', 'ab269ec7-ca89-40b2-bad4-f7b3e1974c4a', 'ee534d9a-124f-4e7f-b1f5-06b84a6ae90c'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b712da-5269-444c-be54-70d54d1fbfa2]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726.91e098e0-15cd-4af1-8fad-e808e239647c {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:55 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-96c051be-a12b-4d5f-bbf6-6d62c2e486b8 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-c708ad85-c23b-47f2-b443-b17da0e2e47f" returned: 0 in 0.643s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-44405ef5-c43f-4c23-98fb-f853d2165cf8 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-44405ef5-c43f-4c23-98fb-f853d2165cf8 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-44405ef5-c43f-4c23-98fb-f853d2165cf8 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-44405ef5-c43f-4c23-98fb-f853d2165cf8 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-44405ef5-c43f-4c23-98fb-f853d2165cf8 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-44405ef5-c43f-4c23-98fb-f853d2165cf8 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-96c051be-a12b-4d5f-bbf6-6d62c2e486b8 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Lock "cinder-quobyte-c708ad85-c23b-47f2-b443-b17da0e2e47f" released by "delete_volume" :: held 2.329s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:49:55 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:49:55 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:55 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726.91e098e0-15cd-4af1-8fad-e808e239647c Jun 04 06:49:55 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-96c051be-a12b-4d5f-bbf6-6d62c2e486b8 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Created reservations ['63fda09b-e305-4f42-bef3-c20bde302a47', '631b62f9-813e-4aca-ac2a-953b35b3c1c4', 'd65841c5-69b3-4c37-9819-d1eb60ddda9c', 'b4e7c1bc-b17d-44b4-b4d8-2489e9916ff4'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-96c051be-a12b-4d5f-bbf6-6d62c2e486b8 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-96c051be-a12b-4d5f-bbf6-6d62c2e486b8 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-96c051be-a12b-4d5f-bbf6-6d62c2e486b8 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-96c051be-a12b-4d5f-bbf6-6d62c2e486b8 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-96c051be-a12b-4d5f-bbf6-6d62c2e486b8 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-96c051be-a12b-4d5f-bbf6-6d62c2e486b8 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:55 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:49:55 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-072fa8c6-fa18-4cb9-97d5-3ca2eead3a74 tempest-VolumeDependencyTests-2006023204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d3d45cf7-171f-4e80-a067-6e631e1f645b tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Acquiring lock "cinder-80dea51f-c91c-4f30-86ba-30231733c704-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d3d45cf7-171f-4e80-a067-6e631e1f645b tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "cinder-80dea51f-c91c-4f30-86ba-30231733c704-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:55 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d3d45cf7-171f-4e80-a067-6e631e1f645b tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Acquiring lock "cinder-quobyte-80dea51f-c91c-4f30-86ba-30231733c704" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:49:56 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d3d45cf7-171f-4e80-a067-6e631e1f645b tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "cinder-quobyte-80dea51f-c91c-4f30-86ba-30231733c704" acquired by "delete_volume" :: waited 0.024s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:49:56 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[406c78fb-c6de-43c9-b54c-1f9e3eb62e3b]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:49:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d3d45cf7-171f-4e80-a067-6e631e1f645b tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-80dea51f-c91c-4f30-86ba-30231733c704 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:56 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-80dea51f-c91c-4f30-86ba-30231733c704 Jun 04 06:49:56 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:56 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-44405ef5-c43f-4c23-98fb-f853d2165cf8 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.726s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:56 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-44405ef5-c43f-4c23-98fb-f853d2165cf8 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:49:56 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-44405ef5-c43f-4c23-98fb-f853d2165cf8 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Deleted volume successfully. Jun 04 06:49:56 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-44405ef5-c43f-4c23-98fb-f853d2165cf8 tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "cinder-119ae78a-4502-4418-aa1b-05f9ddae2046-delete_volume" released by "delete_volume" :: held 2.603s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:49:56 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726.91e098e0-15cd-4af1-8fad-e808e239647c" returned: 0 in 0.845s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:56 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:49:56 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726 {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 06:49:56 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Creating direct copy from snapshot {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 06:49:56 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8059d9-511f-4492-8119-161c8e78ffc0]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:49:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:56 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:56 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726 Jun 04 06:49:56 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-96c051be-a12b-4d5f-bbf6-6d62c2e486b8 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.731s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:56 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-96c051be-a12b-4d5f-bbf6-6d62c2e486b8 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:49:56 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-96c051be-a12b-4d5f-bbf6-6d62c2e486b8 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Deleted volume successfully. Jun 04 06:49:56 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-96c051be-a12b-4d5f-bbf6-6d62c2e486b8 tempest-VolumeAndVolumeTypeFromImageTest-515541269 None] Lock "cinder-c708ad85-c23b-47f2-b443-b17da0e2e47f-delete_volume" released by "delete_volume" :: held 3.318s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:49:56 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d3d45cf7-171f-4e80-a067-6e631e1f645b tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-80dea51f-c91c-4f30-86ba-30231733c704" returned: 0 in 0.841s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:56 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d3d45cf7-171f-4e80-a067-6e631e1f645b tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-80dea51f-c91c-4f30-86ba-30231733c704 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:56 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-80dea51f-c91c-4f30-86ba-30231733c704 Jun 04 06:49:56 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:57 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726" returned: 0 in 0.794s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:57 devstack cinder-volume[86069]: DEBUG cinder.utils [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Path /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-093dad15-e10a-452f-b929-aa0f1e826512 not found in is_blk_device check {{(pid=86069) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 04 06:49:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-093dad15-e10a-452f-b929-aa0f1e826512 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:57 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-093dad15-e10a-452f-b929-aa0f1e826512 Jun 04 06:49:57 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:57 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d3d45cf7-171f-4e80-a067-6e631e1f645b tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-80dea51f-c91c-4f30-86ba-30231733c704" returned: 0 in 0.631s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:57 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d3d45cf7-171f-4e80-a067-6e631e1f645b tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "cinder-quobyte-80dea51f-c91c-4f30-86ba-30231733c704" released by "delete_volume" :: held 1.525s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:49:57 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-d3d45cf7-171f-4e80-a067-6e631e1f645b tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Created reservations ['52a505e7-072c-4382-8f6d-0b7bf0eec65a', 'a90c4a0e-886e-424c-a0ca-dabcfc18a002', 'b9a4b8ad-01f6-446c-9f9b-a50e00108a53', '391cb9d2-26ab-401e-9b1a-b2bdbc70e02b'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:49:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d3d45cf7-171f-4e80-a067-6e631e1f645b tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:49:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d3d45cf7-171f-4e80-a067-6e631e1f645b tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:49:57 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d3d45cf7-171f-4e80-a067-6e631e1f645b tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:49:57 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d3d45cf7-171f-4e80-a067-6e631e1f645b tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:49:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d3d45cf7-171f-4e80-a067-6e631e1f645b tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:49:57 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d3d45cf7-171f-4e80-a067-6e631e1f645b tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:49:57 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:49:57 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:49:58 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Jun 04 06:49:58 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d3d45cf7-171f-4e80-a067-6e631e1f645b tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 1.207s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:49:58 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-d3d45cf7-171f-4e80-a067-6e631e1f645b tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:49:58 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-d3d45cf7-171f-4e80-a067-6e631e1f645b tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Deleted volume successfully. Jun 04 06:49:59 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d3d45cf7-171f-4e80-a067-6e631e1f645b tempest-CreateVolumesFromSourceVolumeTest-1564700670 None] Lock "cinder-80dea51f-c91c-4f30-86ba-30231733c704-delete_volume" released by "delete_volume" :: held 3.066s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:03 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-093dad15-e10a-452f-b929-aa0f1e826512" returned: 0 in 6.189s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:03 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[faeb79e5-5f24-4fe9-84fa-3d9f5c4c134c]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:50:03 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:03 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726 Jun 04 06:50:03 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:04 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726" returned: 0 in 0.908s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:04 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Image conversion details: src /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726, size 1024.00 MB, duration 6.19 sec, destination /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-093dad15-e10a-452f-b929-aa0f1e826512 {{(pid=86069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 06:50:04 devstack cinder-volume[86069]: INFO cinder.image.image_utils [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Converted 1024.00 MB image at 165.43 MB/s Jun 04 06:50:04 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-093dad15-e10a-452f-b929-aa0f1e826512 is being set with open permissions: ugo+rw Jun 04 06:50:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-093dad15-e10a-452f-b929-aa0f1e826512 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:04 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-093dad15-e10a-452f-b929-aa0f1e826512 Jun 04 06:50:04 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:04 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:50:04 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] Flow 'volume_create_manager' (fdf77661-4789-45be-abe9-2c0a6ece3e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:50:04 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7d4dd9-af64-45bb-b53f-c0ccc0b54d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:04 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7d4dd9-af64-45bb-b53f-c0ccc0b54d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-823165188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6c46ca4-2d02-4945-9ae0-02e46d9bb425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c643e778524c0d969ba61bd7e235c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:50:04Z,use_quota=True,user_id='538616e44cc0489ea70ced57baa61069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:04 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dd11909-d3e4-49f1-b6e5-3dee98e82d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:04 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dd11909-d3e4-49f1-b6e5-3dee98e82d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:04 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e98c5006-27e2-47a0-a6dd-f7094fe32b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:04 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e98c5006-27e2-47a0-a6dd-f7094fe32b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6c46ca4-2d02-4945-9ae0-02e46d9bb425', 'volume_name': 'volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:04 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a09f1b6-833c-4f86-ad24-5d3d48ff4fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:04 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a09f1b6-833c-4f86-ad24-5d3d48ff4fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:04 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04320559-7205-40e0-bd49-eb3045f4580b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:04 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] Volume f6c46ca4-2d02-4945-9ae0-02e46d9bb425: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425', 'volume_size': 1} Jun 04 06:50:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:04 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-093dad15-e10a-452f-b929-aa0f1e826512" returned: 0 in 0.639s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:04 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Lock "cinder-quobyte-093dad15-e10a-452f-b929-aa0f1e826512" released by "_copy_volume_from_snapshot" :: held 9.502s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:04 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Lock "cinder-quobyte-91e098e0-15cd-4af1-8fad-e808e239647c-093dad15-e10a-452f-b929-aa0f1e826512" released by "_create_volume_from_snapshot" :: held 9.560s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.611s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-072fa8c6-fa18-4cb9-97d5-3ca2eead3a74 tempest-VolumeDependencyTests-2006023204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.054s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:04 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-072fa8c6-fa18-4cb9-97d5-3ca2eead3a74 tempest-VolumeDependencyTests-2006023204 None] Creating offline snapshot b8932587-7ef1-4f98-982f-5b6de21dc615 of volume 98a465f4-6017-43b4-8760-4bf7380d4ece {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:50:04 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d3d49d4-df41-4491-adc9-2d5e9f8fb637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-093dad15-e10a-452f-b929-aa0f1e826512', 'volume_size': 1, 'snapshot_id': '91e098e0-15cd-4af1-8fad-e808e239647c'}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:04 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffd51a2f-da54-4944-9404-657296990db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:04 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[607757e7-16fc-4f74-a098-4e771ba65be8]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:50:04 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-072fa8c6-fa18-4cb9-97d5-3ca2eead3a74 tempest-VolumeDependencyTests-2006023204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:04 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Volume volume-093dad15-e10a-452f-b929-aa0f1e826512 (093dad15-e10a-452f-b929-aa0f1e826512): created successfully Jun 04 06:50:04 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffd51a2f-da54-4944-9404-657296990db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:04 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Flow 'volume_create_manager' (dc720174-fdd2-48d5-a876-f4e9d813f14e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:50:04 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-546bf6d1-e157-482e-8b0a-5fb4ac6f92a2 tempest-SnapshotDependencyTests-1971429625 None] Created volume successfully. Jun 04 06:50:05 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece Jun 04 06:50:05 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:05 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-072fa8c6-fa18-4cb9-97d5-3ca2eead3a74 tempest-VolumeDependencyTests-2006023204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece" returned: 0 in 0.742s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:05 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-072fa8c6-fa18-4cb9-97d5-3ca2eead3a74 tempest-VolumeDependencyTests-2006023204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece.b8932587-7ef1-4f98-982f-5b6de21dc615 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:05 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece.b8932587-7ef1-4f98-982f-5b6de21dc615 1G Jun 04 06:50:05 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:05 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-634eec70-8e58-46be-ae53-1a4db93abb85 tempest-SnapshotDependencyTests-1971429625 None] Acquiring lock "cinder-91e098e0-15cd-4af1-8fad-e808e239647c-delete_snapshot" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:05 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-634eec70-8e58-46be-ae53-1a4db93abb85 tempest-SnapshotDependencyTests-1971429625 None] Lock "cinder-91e098e0-15cd-4af1-8fad-e808e239647c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:05 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-634eec70-8e58-46be-ae53-1a4db93abb85 tempest-SnapshotDependencyTests-1971429625 None] Acquiring lock "cinder-quobyte-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:05 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-634eec70-8e58-46be-ae53-1a4db93abb85 tempest-SnapshotDependencyTests-1971429625 None] Lock "cinder-quobyte-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:05 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-634eec70-8e58-46be-ae53-1a4db93abb85 tempest-SnapshotDependencyTests-1971429625 None] Acquiring lock "cinder-quobyte-91e098e0-15cd-4af1-8fad-e808e239647c" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:05 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-634eec70-8e58-46be-ae53-1a4db93abb85 tempest-SnapshotDependencyTests-1971429625 None] Lock "cinder-quobyte-91e098e0-15cd-4af1-8fad-e808e239647c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:06 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-634eec70-8e58-46be-ae53-1a4db93abb85 tempest-SnapshotDependencyTests-1971429625 None] Deleting offline snapshot 91e098e0-15cd-4af1-8fad-e808e239647c of volume cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:50:06 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-634eec70-8e58-46be-ae53-1a4db93abb85 tempest-SnapshotDependencyTests-1971429625 None] snapshot_file for this snap is: volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726.91e098e0-15cd-4af1-8fad-e808e239647c {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:50:06 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[39785905-a173-490e-96f8-096adc9458f3]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:50:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-634eec70-8e58-46be-ae53-1a4db93abb85 tempest-SnapshotDependencyTests-1971429625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726.91e098e0-15cd-4af1-8fad-e808e239647c {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:06 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726.91e098e0-15cd-4af1-8fad-e808e239647c Jun 04 06:50:06 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:06 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-072fa8c6-fa18-4cb9-97d5-3ca2eead3a74 tempest-VolumeDependencyTests-2006023204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece.b8932587-7ef1-4f98-982f-5b6de21dc615 1G" returned: 0 in 0.809s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-072fa8c6-fa18-4cb9-97d5-3ca2eead3a74 tempest-VolumeDependencyTests-2006023204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98a465f4-6017-43b4-8760-4bf7380d4ece -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece.b8932587-7ef1-4f98-982f-5b6de21dc615 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:06 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98a465f4-6017-43b4-8760-4bf7380d4ece -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece.b8932587-7ef1-4f98-982f-5b6de21dc615 Jun 04 06:50:06 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:06 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:50:06 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Flow 'volume_create_manager' (90d6c9b3-28e9-4b76-81cc-b9588c64bd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:50:06 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6f6353f-4f9c-490d-8dcb-043dc9b31389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:06 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6f6353f-4f9c-490d-8dcb-043dc9b31389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e108256e-5745-4b56-af5b-772504d3fe01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5879af5574ff4cbd9857ed0c09e0b002',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:50:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:50:07Z,use_quota=True,user_id='3a16c1c593564c088dc95b2988a2cd4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:06 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b62ddae-626d-4cb4-ae27-f0feb1519d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:06 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b62ddae-626d-4cb4-ae27-f0feb1519d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:06 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d9a3e1a-9c80-4a2b-983f-b86ed0bb8f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:06 devstack cinder-volume[86069]: DEBUG cinder.image.glance [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Creating Keystone auth plugin from conf {{(pid=86069) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 04 06:50:06 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-634eec70-8e58-46be-ae53-1a4db93abb85 tempest-SnapshotDependencyTests-1971429625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726.91e098e0-15cd-4af1-8fad-e808e239647c" returned: 0 in 0.797s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:06 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-634eec70-8e58-46be-ae53-1a4db93abb85 tempest-SnapshotDependencyTests-1971429625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:50:06 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[22796359-0f62-43f6-a5fe-d58eda3b4fd4]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:50:06 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-634eec70-8e58-46be-ae53-1a4db93abb85 tempest-SnapshotDependencyTests-1971429625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:07 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726 Jun 04 06:50:07 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:07 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d9a3e1a-9c80-4a2b-983f-b86ed0bb8f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e108256e-5745-4b56-af5b-772504d3fe01', 'volume_name': 'volume-e108256e-5745-4b56-af5b-772504d3fe01', 'volume_size': 1, 'image_id': 'd46b4993-d343-4cef-a67a-53f9a586c627', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d46b4993-d343-4cef-a67a-53f9a586c627', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'daca8bfbbb7889237a6e3c874db605ba', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5879af5574ff4cbd9857ed0c09e0b002', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4493fdac152041c7311050b5b8641638010d4b06fa4717bd6276c66c23eb539b25a71a22c6d927002997adaaefcfd8a9cd71b615c75d692f2c2fadab2fec2110', 'id': 'd46b4993-d343-4cef-a67a-53f9a586c627', 'created_at': datetime.datetime(2026, 6, 4, 4, 50, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 4, 50, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d46b4993-d343-4cef-a67a-53f9a586c627/file', 'properties': {}}, 'image_service': }' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:07 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7895d10d-f063-402e-ba42-99dcb35374a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:07 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7895d10d-f063-402e-ba42-99dcb35374a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:07 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f809a18e-2c9e-48ad-bc3d-3ff6005ec437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:07 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Volume e108256e-5745-4b56-af5b-772504d3fe01: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e108256e-5745-4b56-af5b-772504d3fe01', 'volume_size': 1, 'image_id': 'd46b4993-d343-4cef-a67a-53f9a586c627', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d46b4993-d343-4cef-a67a-53f9a586c627', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'daca8bfbbb7889237a6e3c874db605ba', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5879af5574ff4cbd9857ed0c09e0b002', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4493fdac152041c7311050b5b8641638010d4b06fa4717bd6276c66c23eb539b25a71a22c6d927002997adaaefcfd8a9cd71b615c75d692f2c2fadab2fec2110', 'id': 'd46b4993-d343-4cef-a67a-53f9a586c627', 'created_at': datetime.datetime(2026, 6, 4, 4, 50, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 4, 50, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d46b4993-d343-4cef-a67a-53f9a586c627/file', 'properties': {}}, 'image_service': } Jun 04 06:50:07 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Trying to clone e108256e-5745-4b56-af5b-772504d3fe01 from image d46b4993-d343-4cef-a67a-53f9a586c627 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d46b4993-d343-4cef-a67a-53f9a586c627', 'metadata': {}}]). {{(pid=86069) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 04 06:50:07 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-072fa8c6-fa18-4cb9-97d5-3ca2eead3a74 tempest-VolumeDependencyTests-2006023204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98a465f4-6017-43b4-8760-4bf7380d4ece -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece.b8932587-7ef1-4f98-982f-5b6de21dc615" returned: 0 in 0.699s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:07 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-072fa8c6-fa18-4cb9-97d5-3ca2eead3a74 tempest-VolumeDependencyTests-2006023204 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece.b8932587-7ef1-4f98-982f-5b6de21dc615 is being set with open permissions: ugo+rw Jun 04 06:50:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-072fa8c6-fa18-4cb9-97d5-3ca2eead3a74 tempest-VolumeDependencyTests-2006023204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece.b8932587-7ef1-4f98-982f-5b6de21dc615 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:07 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece.b8932587-7ef1-4f98-982f-5b6de21dc615 Jun 04 06:50:07 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:07 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d46b4993-d343-4cef-a67a-53f9a586c627_nwke3r57devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86069) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 04 06:50:07 devstack cinder-volume[86069]: INFO cinder.image.image_utils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Image download 0.00 MB at 0.00 MB/s Jun 04 06:50:07 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53d2e72-5484-46e2-8534-b8fe8c149670]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:50:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d46b4993-d343-4cef-a67a-53f9a586c627_nwke3r57devstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:07 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d46b4993-d343-4cef-a67a-53f9a586c627_nwke3r57devstack@QuobyteHD Jun 04 06:50:07 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:07 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-634eec70-8e58-46be-ae53-1a4db93abb85 tempest-SnapshotDependencyTests-1971429625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726" returned: 0 in 0.793s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-634eec70-8e58-46be-ae53-1a4db93abb85 tempest-SnapshotDependencyTests-1971429625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726.91e098e0-15cd-4af1-8fad-e808e239647c {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:07 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726.91e098e0-15cd-4af1-8fad-e808e239647c Jun 04 06:50:07 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:07 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-072fa8c6-fa18-4cb9-97d5-3ca2eead3a74 tempest-VolumeDependencyTests-2006023204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece.b8932587-7ef1-4f98-982f-5b6de21dc615" returned: 0 in 0.648s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-072fa8c6-fa18-4cb9-97d5-3ca2eead3a74 tempest-VolumeDependencyTests-2006023204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:07 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece.info Jun 04 06:50:07 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:07 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d46b4993-d343-4cef-a67a-53f9a586c627_nwke3r57devstack@QuobyteHD" returned: 0 in 0.719s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:07 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d46b4993-d343-4cef-a67a-53f9a586c627_nwke3r57devstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:08 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d46b4993-d343-4cef-a67a-53f9a586c627_nwke3r57devstack@QuobyteHD Jun 04 06:50:08 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:08 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-634eec70-8e58-46be-ae53-1a4db93abb85 tempest-SnapshotDependencyTests-1971429625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726.91e098e0-15cd-4af1-8fad-e808e239647c" returned: 0 in 0.711s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-634eec70-8e58-46be-ae53-1a4db93abb85 tempest-SnapshotDependencyTests-1971429625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726.91e098e0-15cd-4af1-8fad-e808e239647c {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:08 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726.91e098e0-15cd-4af1-8fad-e808e239647c Jun 04 06:50:08 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:08 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-072fa8c6-fa18-4cb9-97d5-3ca2eead3a74 tempest-VolumeDependencyTests-2006023204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece.info" returned: 0 in 0.680s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:08 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-072fa8c6-fa18-4cb9-97d5-3ca2eead3a74 tempest-VolumeDependencyTests-2006023204 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece.info is being set with open permissions: ugo+rw Jun 04 06:50:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-072fa8c6-fa18-4cb9-97d5-3ca2eead3a74 tempest-VolumeDependencyTests-2006023204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:08 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece.info Jun 04 06:50:08 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:08 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d46b4993-d343-4cef-a67a-53f9a586c627_nwke3r57devstack@QuobyteHD" returned: 1 in 0.736s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d46b4993-d343-4cef-a67a-53f9a586c627_nwke3r57devstack@QuobyteHD' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:50:08 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Temporary image d46b4993-d343-4cef-a67a-53f9a586c627 is fetched for user 3a16c1c593564c088dc95b2988a2cd4a. {{(pid=86069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 04 06:50:08 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e4dd84-e6d6-42e2-b72a-abe4fa6de333]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:50:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d46b4993-d343-4cef-a67a-53f9a586c627_nwke3r57devstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:08 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d46b4993-d343-4cef-a67a-53f9a586c627_nwke3r57devstack@QuobyteHD Jun 04 06:50:08 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:08 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:08 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-634eec70-8e58-46be-ae53-1a4db93abb85 tempest-SnapshotDependencyTests-1971429625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726.91e098e0-15cd-4af1-8fad-e808e239647c" returned: 0 in 0.614s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:09 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-634eec70-8e58-46be-ae53-1a4db93abb85 tempest-SnapshotDependencyTests-1971429625 None] Lock "cinder-quobyte-91e098e0-15cd-4af1-8fad-e808e239647c" released by "_delete_snapshot" :: held 3.055s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:09 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-634eec70-8e58-46be-ae53-1a4db93abb85 tempest-SnapshotDependencyTests-1971429625 None] Lock "cinder-quobyte-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726" released by "delete_snapshot" :: held 3.102s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:09 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-634eec70-8e58-46be-ae53-1a4db93abb85 tempest-SnapshotDependencyTests-1971429625 None] Created reservations ['073e92d1-0372-4533-9187-e08d44bc61a0', '8504996e-63ec-4510-a40b-72492e49e0a4', '5b92fa25-18cf-45a2-b381-3f527d9c2543', 'c1e636ce-13b8-405e-b63d-cade9bb4cc30'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:50:09 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-072fa8c6-fa18-4cb9-97d5-3ca2eead3a74 tempest-VolumeDependencyTests-2006023204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece.info" returned: 0 in 0.665s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-072fa8c6-fa18-4cb9-97d5-3ca2eead3a74 tempest-VolumeDependencyTests-2006023204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.361s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.631s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:09 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-823165188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6c46ca4-2d02-4945-9ae0-02e46d9bb425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c643e778524c0d969ba61bd7e235c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:50:04Z,use_quota=True,user_id='538616e44cc0489ea70ced57baa61069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:50:09 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] Creating volume f6c46ca4-2d02-4945-9ae0-02e46d9bb425 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:50:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:09 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:50:09 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:50:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:09 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:50:09 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:50:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:09 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425 1073741824 Jun 04 06:50:09 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:09 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-072fa8c6-fa18-4cb9-97d5-3ca2eead3a74 tempest-VolumeDependencyTests-2006023204 None] Create snapshot completed successfully Jun 04 06:50:09 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-634eec70-8e58-46be-ae53-1a4db93abb85 tempest-SnapshotDependencyTests-1971429625 None] Delete snapshot completed successfully. Jun 04 06:50:09 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-634eec70-8e58-46be-ae53-1a4db93abb85 tempest-SnapshotDependencyTests-1971429625 None] Lock "cinder-91e098e0-15cd-4af1-8fad-e808e239647c-delete_snapshot" released by "delete_snapshot" :: held 3.330s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:09 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d46b4993-d343-4cef-a67a-53f9a586c627_nwke3r57devstack@QuobyteHD" returned: 0 in 0.751s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:09 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d46b4993-d343-4cef-a67a-53f9a586c627_nwke3r57devstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:09 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d46b4993-d343-4cef-a67a-53f9a586c627_nwke3r57devstack@QuobyteHD Jun 04 06:50:09 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:10 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425 1073741824" returned: 0 in 0.822s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:10 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425 Jun 04 06:50:10 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-829fddf5-5f51-4c3b-8160-4e1c33709e38 tempest-SnapshotDependencyTests-1971429625 None] Acquiring lock "cinder-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-829fddf5-5f51-4c3b-8160-4e1c33709e38 tempest-SnapshotDependencyTests-1971429625 None] Lock "cinder-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-829fddf5-5f51-4c3b-8160-4e1c33709e38 tempest-SnapshotDependencyTests-1971429625 None] Acquiring lock "cinder-quobyte-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-829fddf5-5f51-4c3b-8160-4e1c33709e38 tempest-SnapshotDependencyTests-1971429625 None] Lock "cinder-quobyte-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726" acquired by "delete_volume" :: waited 0.028s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:10 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d46b4993-d343-4cef-a67a-53f9a586c627_nwke3r57devstack@QuobyteHD" returned: 1 in 0.806s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d46b4993-d343-4cef-a67a-53f9a586c627_nwke3r57devstack@QuobyteHD' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee81c9ac-d1f1-4b13-a5d0-da69365f0cae]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-829fddf5-5f51-4c3b-8160-4e1c33709e38 tempest-SnapshotDependencyTests-1971429625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Flow 'volume_create_manager' (0f92b6d9-ca65-4d3f-a075-c65fe43b672d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db0fc2e0-ea59-46d0-8b57-22ddb02c3410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db0fc2e0-ea59-46d0-8b57-22ddb02c3410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-76365319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd7f68a3-ed58-469b-98d8-c753b82d44a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='737e3986fade4a90ad7d6eec4d996363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b8932587-7ef1-4f98-982f-5b6de21dc615,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:50:10Z,use_quota=True,user_id='54d445e2be3f4449bea50de938d6b590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02cbdde5-ad23-43a1-9409-1a8c10562417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02cbdde5-ad23-43a1-9409-1a8c10562417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:10 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726 Jun 04 06:50:10 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee7c005-7859-4bcf-8863-a2a44290b48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee7c005-7859-4bcf-8863-a2a44290b48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cd7f68a3-ed58-469b-98d8-c753b82d44a5', 'volume_name': 'volume-cd7f68a3-ed58-469b-98d8-c753b82d44a5', 'volume_size': 1, 'snapshot_id': 'b8932587-7ef1-4f98-982f-5b6de21dc615'}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f52dd1a1-42d1-4ffe-82d9-0eeab860d41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f52dd1a1-42d1-4ffe-82d9-0eeab860d41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f20a941-76b5-41dd-b939-8d5aae62b2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:10 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Volume cd7f68a3-ed58-469b-98d8-c753b82d44a5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cd7f68a3-ed58-469b-98d8-c753b82d44a5', 'volume_size': 1, 'snapshot_id': 'b8932587-7ef1-4f98-982f-5b6de21dc615'} Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:10 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425" returned: 0 in 0.700s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.410s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e108256e-5745-4b56-af5b-772504d3fe01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5879af5574ff4cbd9857ed0c09e0b002',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:50:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:50:07Z,use_quota=True,user_id='3a16c1c593564c088dc95b2988a2cd4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Creating volume e108256e-5745-4b56-af5b-772504d3fe01 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:50:10 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e108256e-5745-4b56-af5b-772504d3fe01 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:10 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e108256e-5745-4b56-af5b-772504d3fe01 1073741824 Jun 04 06:50:10 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04320559-7205-40e0-bd49-eb3045f4580b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f43eb3be-5c7c-4160-8384-533827ee8f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:10 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] Volume volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425 (f6c46ca4-2d02-4945-9ae0-02e46d9bb425): created successfully Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f43eb3be-5c7c-4160-8384-533827ee8f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:10 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] Flow 'volume_create_manager' (fdf77661-4789-45be-abe9-2c0a6ece3e23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:50:10 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-1cdb7641-96ed-4dce-8fca-ae42fef0b7a1 tempest-CreateVolumesFromSnapshotTest-886612007 None] Created volume successfully. Jun 04 06:50:11 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-829fddf5-5f51-4c3b-8160-4e1c33709e38 tempest-SnapshotDependencyTests-1971429625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726" returned: 0 in 0.718s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-829fddf5-5f51-4c3b-8160-4e1c33709e38 tempest-SnapshotDependencyTests-1971429625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:11 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726 Jun 04 06:50:11 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:50:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:50:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:50:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:11 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:50:11 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:11 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e108256e-5745-4b56-af5b-772504d3fe01 1073741824" returned: 0 in 0.828s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e108256e-5745-4b56-af5b-772504d3fe01 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:11 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e108256e-5745-4b56-af5b-772504d3fe01 Jun 04 06:50:11 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:11 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-829fddf5-5f51-4c3b-8160-4e1c33709e38 tempest-SnapshotDependencyTests-1971429625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726" returned: 0 in 0.629s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:11 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-829fddf5-5f51-4c3b-8160-4e1c33709e38 tempest-SnapshotDependencyTests-1971429625 None] Lock "cinder-quobyte-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726" released by "delete_volume" :: held 1.442s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:11 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.608s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:11 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:50:11 devstack cinder-volume[86069]: DEBUG oslo_service.periodic_task [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] Running periodic task VolumeManager._thread_info {{(pid=86069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 06:50:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread count: 28 {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 06:50:11 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e2cb8e52-ba93-4804-80f0-b3be91576cba None None] thread info: [<_MainThread(MainThread, started 131797370544256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 06:50:11 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-829fddf5-5f51-4c3b-8160-4e1c33709e38 tempest-SnapshotDependencyTests-1971429625 None] Created reservations ['ec97d2af-57b7-4959-865d-7c7c4d08f6f1', 'ccbcb931-8c7e-455c-a2f0-4f7e8e230b3d', '770f7907-6470-4061-a6c6-98b6e2f6d65f', 'f0476be3-b253-4ee9-b8af-0a2301a55e0b'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:50:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-829fddf5-5f51-4c3b-8160-4e1c33709e38 tempest-SnapshotDependencyTests-1971429625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-829fddf5-5f51-4c3b-8160-4e1c33709e38 tempest-SnapshotDependencyTests-1971429625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-829fddf5-5f51-4c3b-8160-4e1c33709e38 tempest-SnapshotDependencyTests-1971429625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:50:11 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-829fddf5-5f51-4c3b-8160-4e1c33709e38 tempest-SnapshotDependencyTests-1971429625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:50:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-829fddf5-5f51-4c3b-8160-4e1c33709e38 tempest-SnapshotDependencyTests-1971429625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:11 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-829fddf5-5f51-4c3b-8160-4e1c33709e38 tempest-SnapshotDependencyTests-1971429625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:11 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:50:11 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0721b00b-903b-43fc-a825-ecbec0bfbb1d tempest-CreateVolumesFromSnapshotTest-886612007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:12 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e108256e-5745-4b56-af5b-772504d3fe01" returned: 0 in 0.640s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.780s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Acquiring lock "cinder-quobyte-b8932587-7ef1-4f98-982f-5b6de21dc615-cd7f68a3-ed58-469b-98d8-c753b82d44a5" by "_create_volume_from_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Lock "cinder-quobyte-b8932587-7ef1-4f98-982f-5b6de21dc615-cd7f68a3-ed58-469b-98d8-c753b82d44a5" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Creating volume cd7f68a3-ed58-469b-98d8-c753b82d44a5 from snapshot b8932587-7ef1-4f98-982f-5b6de21dc615 {{(pid=86069) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Acquiring lock "cinder-quobyte-cd7f68a3-ed58-469b-98d8-c753b82d44a5" by "_copy_volume_from_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG cinder.volume.volume_utils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Attempting download of d46b4993-d343-4cef-a67a-53f9a586c627 ((None, [{'url': 'file:///opt/stack/data/glance/images/d46b4993-d343-4cef-a67a-53f9a586c627', 'metadata': {}}])) to volume e108256e-5745-4b56-af5b-772504d3fe01. {{(pid=86069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Lock "cinder-quobyte-cd7f68a3-ed58-469b-98d8-c753b82d44a5" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] snapshot: b8932587-7ef1-4f98-982f-5b6de21dc615, volume: cd7f68a3-ed58-469b-98d8-c753b82d44a5, {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[3971756e-9971-45b2-83be-99cec4c01715]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece.b8932587-7ef1-4f98-982f-5b6de21dc615 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb73470-fa05-4ccf-a44a-5ffbdb78ec3c]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d46b4993-d343-4cef-a67a-53f9a586c627_25mjwl5i {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1b9241ff-b54e-4760-93a0-2bd16fe14e17 tempest-SnapshotDependencyTests-1971429625 None] Acquiring lock "cinder-093dad15-e10a-452f-b929-aa0f1e826512-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:12 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1b9241ff-b54e-4760-93a0-2bd16fe14e17 tempest-SnapshotDependencyTests-1971429625 None] Lock "cinder-093dad15-e10a-452f-b929-aa0f1e826512-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-829fddf5-5f51-4c3b-8160-4e1c33709e38 tempest-SnapshotDependencyTests-1971429625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.671s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-829fddf5-5f51-4c3b-8160-4e1c33709e38 tempest-SnapshotDependencyTests-1971429625 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:50:12 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-829fddf5-5f51-4c3b-8160-4e1c33709e38 tempest-SnapshotDependencyTests-1971429625 None] Deleted volume successfully. Jun 04 06:50:12 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece.b8932587-7ef1-4f98-982f-5b6de21dc615 Jun 04 06:50:12 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-829fddf5-5f51-4c3b-8160-4e1c33709e38 tempest-SnapshotDependencyTests-1971429625 None] Lock "cinder-cb4a5e6d-5d14-4af9-8dc4-dfbfb325b726-delete_volume" released by "delete_volume" :: held 2.370s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1b9241ff-b54e-4760-93a0-2bd16fe14e17 tempest-SnapshotDependencyTests-1971429625 None] Acquiring lock "cinder-quobyte-093dad15-e10a-452f-b929-aa0f1e826512" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1b9241ff-b54e-4760-93a0-2bd16fe14e17 tempest-SnapshotDependencyTests-1971429625 None] Lock "cinder-quobyte-093dad15-e10a-452f-b929-aa0f1e826512" acquired by "delete_volume" :: waited 0.018s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c97040e-fb95-449e-b4e2-3c3128560f6f]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:50:12 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1b9241ff-b54e-4760-93a0-2bd16fe14e17 tempest-SnapshotDependencyTests-1971429625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-093dad15-e10a-452f-b929-aa0f1e826512 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:12 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d46b4993-d343-4cef-a67a-53f9a586c627_25mjwl5i Jun 04 06:50:12 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:12 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-093dad15-e10a-452f-b929-aa0f1e826512 Jun 04 06:50:12 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:13 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece.b8932587-7ef1-4f98-982f-5b6de21dc615" returned: 0 in 0.788s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:13 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98a465f4-6017-43b4-8760-4bf7380d4ece(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:50:13 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 06:50:13 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Creating direct copy from snapshot {{(pid=86069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 06:50:13 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d46b4993-d343-4cef-a67a-53f9a586c627_25mjwl5i" returned: 0 in 0.775s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d46b4993-d343-4cef-a67a-53f9a586c627_25mjwl5i {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:13 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2896ce6-74eb-4fb4-9b76-d3758ae6a3c2]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:50:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:13 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d46b4993-d343-4cef-a67a-53f9a586c627_25mjwl5i Jun 04 06:50:13 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:13 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1b9241ff-b54e-4760-93a0-2bd16fe14e17 tempest-SnapshotDependencyTests-1971429625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-093dad15-e10a-452f-b929-aa0f1e826512" returned: 0 in 0.726s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1b9241ff-b54e-4760-93a0-2bd16fe14e17 tempest-SnapshotDependencyTests-1971429625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-093dad15-e10a-452f-b929-aa0f1e826512 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:13 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece Jun 04 06:50:13 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:13 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-093dad15-e10a-452f-b929-aa0f1e826512 Jun 04 06:50:13 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:13 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1b9241ff-b54e-4760-93a0-2bd16fe14e17 tempest-SnapshotDependencyTests-1971429625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-093dad15-e10a-452f-b929-aa0f1e826512" returned: 0 in 0.589s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:13 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:13 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece" returned: 0 in 0.715s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d46b4993-d343-4cef-a67a-53f9a586c627_25mjwl5i" returned: 1 in 0.728s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d46b4993-d343-4cef-a67a-53f9a586c627_25mjwl5i' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:50:13 devstack cinder-volume[86069]: DEBUG cinder.utils [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Path /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cd7f68a3-ed58-469b-98d8-c753b82d44a5 not found in is_blk_device check {{(pid=86069) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 04 06:50:13 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cd7f68a3-ed58-469b-98d8-c753b82d44a5 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:13 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1b9241ff-b54e-4760-93a0-2bd16fe14e17 tempest-SnapshotDependencyTests-1971429625 None] Lock "cinder-quobyte-093dad15-e10a-452f-b929-aa0f1e826512" released by "delete_volume" :: held 1.373s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:14 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1c81b9-8d7b-4762-a0c2-529683497670]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:50:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d46b4993-d343-4cef-a67a-53f9a586c627_nwke3r57devstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:14 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cd7f68a3-ed58-469b-98d8-c753b82d44a5 Jun 04 06:50:14 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:14 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-1b9241ff-b54e-4760-93a0-2bd16fe14e17 tempest-SnapshotDependencyTests-1971429625 None] Created reservations ['0dfa1729-7f04-4697-a618-d64749ad5886', '883c1b25-730b-44ac-83bb-56d0d9877976', 'ed3bde87-eefa-41e6-8fcb-8dfd0ab4fc77', '11f86d17-e1fc-486e-836a-d127877ada17'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:50:14 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d46b4993-d343-4cef-a67a-53f9a586c627_nwke3r57devstack@QuobyteHD Jun 04 06:50:14 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-1b9241ff-b54e-4760-93a0-2bd16fe14e17 tempest-SnapshotDependencyTests-1971429625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-1b9241ff-b54e-4760-93a0-2bd16fe14e17 tempest-SnapshotDependencyTests-1971429625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:14 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-1b9241ff-b54e-4760-93a0-2bd16fe14e17 tempest-SnapshotDependencyTests-1971429625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:50:14 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-1b9241ff-b54e-4760-93a0-2bd16fe14e17 tempest-SnapshotDependencyTests-1971429625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:50:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-1b9241ff-b54e-4760-93a0-2bd16fe14e17 tempest-SnapshotDependencyTests-1971429625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1b9241ff-b54e-4760-93a0-2bd16fe14e17 tempest-SnapshotDependencyTests-1971429625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:14 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:50:14 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:14 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d46b4993-d343-4cef-a67a-53f9a586c627_nwke3r57devstack@QuobyteHD" returned: 0 in 0.742s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d46b4993-d343-4cef-a67a-53f9a586c627_nwke3r57devstack@QuobyteHD {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:14 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:14 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-1b9241ff-b54e-4760-93a0-2bd16fe14e17 tempest-SnapshotDependencyTests-1971429625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.690s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:14 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-1b9241ff-b54e-4760-93a0-2bd16fe14e17 tempest-SnapshotDependencyTests-1971429625 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:50:14 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-1b9241ff-b54e-4760-93a0-2bd16fe14e17 tempest-SnapshotDependencyTests-1971429625 None] Deleted volume successfully. Jun 04 06:50:14 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-1b9241ff-b54e-4760-93a0-2bd16fe14e17 tempest-SnapshotDependencyTests-1971429625 None] Lock "cinder-093dad15-e10a-452f-b929-aa0f1e826512-delete_volume" released by "delete_volume" :: held 2.348s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:14 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d46b4993-d343-4cef-a67a-53f9a586c627_nwke3r57devstack@QuobyteHD Jun 04 06:50:14 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:16 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d46b4993-d343-4cef-a67a-53f9a586c627_nwke3r57devstack@QuobyteHD" returned: 1 in 1.422s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d46b4993-d343-4cef-a67a-53f9a586c627_nwke3r57devstack@QuobyteHD' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:50:16 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] d46b4993-d343-4cef-a67a-53f9a586c627 was raw, converting to raw {{(pid=86069) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 04 06:50:16 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d46b4993-d343-4cef-a67a-53f9a586c627_nwke3r57devstack@QuobyteHD /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e108256e-5745-4b56-af5b-772504d3fe01 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:16 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d46b4993-d343-4cef-a67a-53f9a586c627_nwke3r57devstack@QuobyteHD /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e108256e-5745-4b56-af5b-772504d3fe01 Jun 04 06:50:16 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:18 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d46b4993-d343-4cef-a67a-53f9a586c627_nwke3r57devstack@QuobyteHD /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e108256e-5745-4b56-af5b-772504d3fe01" returned: 0 in 1.910s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:18 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d46b4993-d343-4cef-a67a-53f9a586c627_nwke3r57devstack@QuobyteHD, size 0.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e108256e-5745-4b56-af5b-772504d3fe01 {{(pid=86069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 06:50:18 devstack cinder-volume[86069]: INFO cinder.image.image_utils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Converted 0.00 MB image at 0.00 MB/s Jun 04 06:50:18 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e108256e-5745-4b56-af5b-772504d3fe01 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:18 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e108256e-5745-4b56-af5b-772504d3fe01 1G Jun 04 06:50:18 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:19 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e108256e-5745-4b56-af5b-772504d3fe01 1G" returned: 0 in 1.450s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:19 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d3950f-09ea-4bde-abff-049f1cf69ead]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:50:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e108256e-5745-4b56-af5b-772504d3fe01 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:19 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cd7f68a3-ed58-469b-98d8-c753b82d44a5" returned: 0 in 5.641s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:19 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae92d180-fd6c-4b26-8e3d-71cbd72cf173]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:50:19 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:19 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e108256e-5745-4b56-af5b-772504d3fe01 Jun 04 06:50:19 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:19 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece Jun 04 06:50:19 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:20 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e108256e-5745-4b56-af5b-772504d3fe01" returned: 0 in 0.768s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e108256e-5745-4b56-af5b-772504d3fe01 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:20 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e108256e-5745-4b56-af5b-772504d3fe01 Jun 04 06:50:20 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:20 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece" returned: 0 in 0.939s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:20 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Image conversion details: src /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece, size 1024.00 MB, duration 5.64 sec, destination /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cd7f68a3-ed58-469b-98d8-c753b82d44a5 {{(pid=86069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 06:50:20 devstack cinder-volume[86069]: INFO cinder.image.image_utils [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Converted 1024.00 MB image at 181.48 MB/s Jun 04 06:50:20 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cd7f68a3-ed58-469b-98d8-c753b82d44a5 is being set with open permissions: ugo+rw Jun 04 06:50:20 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cd7f68a3-ed58-469b-98d8-c753b82d44a5 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:20 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cd7f68a3-ed58-469b-98d8-c753b82d44a5 Jun 04 06:50:20 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:21 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e108256e-5745-4b56-af5b-772504d3fe01" returned: 1 in 0.905s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e108256e-5745-4b56-af5b-772504d3fe01' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:50:21 devstack cinder-volume[86069]: DEBUG cinder.volume.volume_utils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Downloaded image d46b4993-d343-4cef-a67a-53f9a586c627 ((None, [{'url': 'file:///opt/stack/data/glance/images/d46b4993-d343-4cef-a67a-53f9a586c627', 'metadata': {}}])) to volume e108256e-5745-4b56-af5b-772504d3fe01 successfully. {{(pid=86069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 04 06:50:21 devstack cinder-volume[86069]: DEBUG cinder.image.image_utils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Temporary image d46b4993-d343-4cef-a67a-53f9a586c627 for user 3a16c1c593564c088dc95b2988a2cd4a is deleted. {{(pid=86069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 04 06:50:21 devstack cinder-volume[86069]: DEBUG cinder.volume.volume_utils [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Marking volume e108256e-5745-4b56-af5b-772504d3fe01 as bootable. {{(pid=86069) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 04 06:50:21 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=127,cinder:UPDATE=179,cinder:INSERT=41,cinder:DELETE=12 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:50:21 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Copying metadata from image d46b4993-d343-4cef-a67a-53f9a586c627 to e108256e-5745-4b56-af5b-772504d3fe01. {{(pid=86069) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 04 06:50:21 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Creating volume glance metadata for volume e108256e-5745-4b56-af5b-772504d3fe01 backed by image d46b4993-d343-4cef-a67a-53f9a586c627 with: {'image_id': 'd46b4993-d343-4cef-a67a-53f9a586c627', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'daca8bfbbb7889237a6e3c874db605ba', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86069) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 04 06:50:21 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:UPDATE=168,cinder:SELECT=128,cinder:INSERT=48,cinder:DELETE=20 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:50:21 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:21 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f809a18e-2c9e-48ad-bc3d-3ff6005ec437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e108256e-5745-4b56-af5b-772504d3fe01', 'volume_size': 1, 'image_id': 'd46b4993-d343-4cef-a67a-53f9a586c627', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d46b4993-d343-4cef-a67a-53f9a586c627', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'daca8bfbbb7889237a6e3c874db605ba', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5879af5574ff4cbd9857ed0c09e0b002', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4493fdac152041c7311050b5b8641638010d4b06fa4717bd6276c66c23eb539b25a71a22c6d927002997adaaefcfd8a9cd71b615c75d692f2c2fadab2fec2110', 'id': 'd46b4993-d343-4cef-a67a-53f9a586c627', 'created_at': datetime.datetime(2026, 6, 4, 4, 50, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 4, 50, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d46b4993-d343-4cef-a67a-53f9a586c627/file', 'properties': {}}, 'image_service': }' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:21 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa8f0ab-dfa6-45b0-841d-1c2ea02d87cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cd7f68a3-ed58-469b-98d8-c753b82d44a5" returned: 0 in 0.815s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:21 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Volume volume-e108256e-5745-4b56-af5b-772504d3fe01 (e108256e-5745-4b56-af5b-772504d3fe01): created successfully Jun 04 06:50:21 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa8f0ab-dfa6-45b0-841d-1c2ea02d87cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:21 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Flow 'volume_create_manager' (90d6c9b3-28e9-4b76-81cc-b9588c64bd17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:50:21 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Lock "cinder-quobyte-cd7f68a3-ed58-469b-98d8-c753b82d44a5" released by "_copy_volume_from_snapshot" :: held 9.058s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:21 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Lock "cinder-quobyte-b8932587-7ef1-4f98-982f-5b6de21dc615-cd7f68a3-ed58-469b-98d8-c753b82d44a5" released by "_create_volume_from_snapshot" :: held 9.099s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.121s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0721b00b-903b-43fc-a825-ecbec0bfbb1d tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.291s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:21 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-209f6af8-521b-452c-bedb-885a95673ab0 tempest-VolumeImageDependencyTests-1364941386 None] Created volume successfully. Jun 04 06:50:21 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-0721b00b-903b-43fc-a825-ecbec0bfbb1d tempest-CreateVolumesFromSnapshotTest-886612007 None] Creating offline snapshot bd7c9445-23ca-48c6-b27e-fb23b70f8b5d of volume f6c46ca4-2d02-4945-9ae0-02e46d9bb425 {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:50:21 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f20a941-76b5-41dd-b939-8d5aae62b2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd7f68a3-ed58-469b-98d8-c753b82d44a5', 'volume_size': 1, 'snapshot_id': 'b8932587-7ef1-4f98-982f-5b6de21dc615'}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:21 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5539d6d9-fcda-4161-a755-5fe5e379c738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:21 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[faad70cb-39ff-43ff-a569-dce4c49f7aee]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:50:21 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0721b00b-903b-43fc-a825-ecbec0bfbb1d tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:21 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Volume volume-cd7f68a3-ed58-469b-98d8-c753b82d44a5 (cd7f68a3-ed58-469b-98d8-c753b82d44a5): created successfully Jun 04 06:50:21 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5539d6d9-fcda-4161-a755-5fe5e379c738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:21 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Flow 'volume_create_manager' (0f92b6d9-ca65-4d3f-a075-c65fe43b672d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:50:21 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-ee95e8fc-4fd0-4a05-9bdc-7333531df1f3 tempest-VolumeDependencyTests-2006023204 None] Created volume successfully. Jun 04 06:50:21 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425 Jun 04 06:50:21 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:22 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0721b00b-903b-43fc-a825-ecbec0bfbb1d tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425" returned: 0 in 0.949s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0721b00b-903b-43fc-a825-ecbec0bfbb1d tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425.bd7c9445-23ca-48c6-b27e-fb23b70f8b5d 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:22 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425.bd7c9445-23ca-48c6-b27e-fb23b70f8b5d 1G Jun 04 06:50:22 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:22 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-64179cd1-a05a-4ae5-b3c0-6ddf5a145f29 tempest-VolumeImageDependencyTests-1364941386 None] Acquiring lock "cinder-e108256e-5745-4b56-af5b-772504d3fe01-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:22 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-64179cd1-a05a-4ae5-b3c0-6ddf5a145f29 tempest-VolumeImageDependencyTests-1364941386 None] Lock "cinder-e108256e-5745-4b56-af5b-772504d3fe01-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:22 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-64179cd1-a05a-4ae5-b3c0-6ddf5a145f29 tempest-VolumeImageDependencyTests-1364941386 None] Acquiring lock "cinder-quobyte-e108256e-5745-4b56-af5b-772504d3fe01" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:22 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-64179cd1-a05a-4ae5-b3c0-6ddf5a145f29 tempest-VolumeImageDependencyTests-1364941386 None] Lock "cinder-quobyte-e108256e-5745-4b56-af5b-772504d3fe01" acquired by "delete_volume" :: waited 0.031s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:22 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f94d5a-de2c-42d6-ba94-7996107d8789]: (4, 'raw') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:50:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-64179cd1-a05a-4ae5-b3c0-6ddf5a145f29 tempest-VolumeImageDependencyTests-1364941386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e108256e-5745-4b56-af5b-772504d3fe01 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:22 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9e7f6117-2bdf-4f7c-8fb1-09c9fa11d3c3 tempest-VolumeDependencyTests-2006023204 None] Acquiring lock "cinder-b8932587-7ef1-4f98-982f-5b6de21dc615-delete_snapshot" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:22 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9e7f6117-2bdf-4f7c-8fb1-09c9fa11d3c3 tempest-VolumeDependencyTests-2006023204 None] Lock "cinder-b8932587-7ef1-4f98-982f-5b6de21dc615-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:22 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9e7f6117-2bdf-4f7c-8fb1-09c9fa11d3c3 tempest-VolumeDependencyTests-2006023204 None] Acquiring lock "cinder-quobyte-98a465f4-6017-43b4-8760-4bf7380d4ece" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:22 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9e7f6117-2bdf-4f7c-8fb1-09c9fa11d3c3 tempest-VolumeDependencyTests-2006023204 None] Lock "cinder-quobyte-98a465f4-6017-43b4-8760-4bf7380d4ece" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:22 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9e7f6117-2bdf-4f7c-8fb1-09c9fa11d3c3 tempest-VolumeDependencyTests-2006023204 None] Acquiring lock "cinder-quobyte-b8932587-7ef1-4f98-982f-5b6de21dc615" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:22 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9e7f6117-2bdf-4f7c-8fb1-09c9fa11d3c3 tempest-VolumeDependencyTests-2006023204 None] Lock "cinder-quobyte-b8932587-7ef1-4f98-982f-5b6de21dc615" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:22 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-9e7f6117-2bdf-4f7c-8fb1-09c9fa11d3c3 tempest-VolumeDependencyTests-2006023204 None] Deleting offline snapshot b8932587-7ef1-4f98-982f-5b6de21dc615 of volume 98a465f4-6017-43b4-8760-4bf7380d4ece {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:50:22 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-9e7f6117-2bdf-4f7c-8fb1-09c9fa11d3c3 tempest-VolumeDependencyTests-2006023204 None] snapshot_file for this snap is: volume-98a465f4-6017-43b4-8760-4bf7380d4ece.b8932587-7ef1-4f98-982f-5b6de21dc615 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:50:22 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc4380c-0bf4-467b-ad64-337ea0e842f6]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:50:22 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9e7f6117-2bdf-4f7c-8fb1-09c9fa11d3c3 tempest-VolumeDependencyTests-2006023204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece.b8932587-7ef1-4f98-982f-5b6de21dc615 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:22 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e108256e-5745-4b56-af5b-772504d3fe01 Jun 04 06:50:22 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:22 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece.b8932587-7ef1-4f98-982f-5b6de21dc615 Jun 04 06:50:22 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:23 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0721b00b-903b-43fc-a825-ecbec0bfbb1d tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425.bd7c9445-23ca-48c6-b27e-fb23b70f8b5d 1G" returned: 0 in 0.949s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0721b00b-903b-43fc-a825-ecbec0bfbb1d tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425.bd7c9445-23ca-48c6-b27e-fb23b70f8b5d {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:23 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425.bd7c9445-23ca-48c6-b27e-fb23b70f8b5d Jun 04 06:50:23 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:23 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9e7f6117-2bdf-4f7c-8fb1-09c9fa11d3c3 tempest-VolumeDependencyTests-2006023204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece.b8932587-7ef1-4f98-982f-5b6de21dc615" returned: 0 in 0.825s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:23 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-9e7f6117-2bdf-4f7c-8fb1-09c9fa11d3c3 tempest-VolumeDependencyTests-2006023204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98a465f4-6017-43b4-8760-4bf7380d4ece(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:50:23 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-64179cd1-a05a-4ae5-b3c0-6ddf5a145f29 tempest-VolumeImageDependencyTests-1364941386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e108256e-5745-4b56-af5b-772504d3fe01" returned: 0 in 1.053s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-64179cd1-a05a-4ae5-b3c0-6ddf5a145f29 tempest-VolumeImageDependencyTests-1364941386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e108256e-5745-4b56-af5b-772504d3fe01 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:23 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b65546-81cf-4ca5-9923-7ee0560242e4]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:50:23 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9e7f6117-2bdf-4f7c-8fb1-09c9fa11d3c3 tempest-VolumeDependencyTests-2006023204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:23 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e108256e-5745-4b56-af5b-772504d3fe01 Jun 04 06:50:23 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:23 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece Jun 04 06:50:23 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:24 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0721b00b-903b-43fc-a825-ecbec0bfbb1d tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425.bd7c9445-23ca-48c6-b27e-fb23b70f8b5d" returned: 0 in 0.917s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:24 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-0721b00b-903b-43fc-a825-ecbec0bfbb1d tempest-CreateVolumesFromSnapshotTest-886612007 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425.bd7c9445-23ca-48c6-b27e-fb23b70f8b5d is being set with open permissions: ugo+rw Jun 04 06:50:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0721b00b-903b-43fc-a825-ecbec0bfbb1d tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425.bd7c9445-23ca-48c6-b27e-fb23b70f8b5d {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:24 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425.bd7c9445-23ca-48c6-b27e-fb23b70f8b5d Jun 04 06:50:24 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:24 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9e7f6117-2bdf-4f7c-8fb1-09c9fa11d3c3 tempest-VolumeDependencyTests-2006023204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece" returned: 0 in 0.942s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9e7f6117-2bdf-4f7c-8fb1-09c9fa11d3c3 tempest-VolumeDependencyTests-2006023204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece.b8932587-7ef1-4f98-982f-5b6de21dc615 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:24 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-64179cd1-a05a-4ae5-b3c0-6ddf5a145f29 tempest-VolumeImageDependencyTests-1364941386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e108256e-5745-4b56-af5b-772504d3fe01" returned: 1 in 0.983s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-64179cd1-a05a-4ae5-b3c0-6ddf5a145f29 tempest-VolumeImageDependencyTests-1364941386 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e108256e-5745-4b56-af5b-772504d3fe01' failed. Not Retrying. {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 06:50:24 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-64179cd1-a05a-4ae5-b3c0-6ddf5a145f29 tempest-VolumeImageDependencyTests-1364941386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e108256e-5745-4b56-af5b-772504d3fe01 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:24 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece.b8932587-7ef1-4f98-982f-5b6de21dc615 Jun 04 06:50:24 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:24 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e108256e-5745-4b56-af5b-772504d3fe01 Jun 04 06:50:24 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:25 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0721b00b-903b-43fc-a825-ecbec0bfbb1d tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425.bd7c9445-23ca-48c6-b27e-fb23b70f8b5d" returned: 0 in 0.743s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0721b00b-903b-43fc-a825-ecbec0bfbb1d tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:25 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425.info Jun 04 06:50:25 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:25 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-64179cd1-a05a-4ae5-b3c0-6ddf5a145f29 tempest-VolumeImageDependencyTests-1364941386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e108256e-5745-4b56-af5b-772504d3fe01" returned: 0 in 0.756s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:25 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-64179cd1-a05a-4ae5-b3c0-6ddf5a145f29 tempest-VolumeImageDependencyTests-1364941386 None] Lock "cinder-quobyte-e108256e-5745-4b56-af5b-772504d3fe01" released by "delete_volume" :: held 2.903s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:25 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-64179cd1-a05a-4ae5-b3c0-6ddf5a145f29 tempest-VolumeImageDependencyTests-1364941386 None] Created reservations ['e8cac406-d35d-4d49-b82a-4b9e8f2e77ee', '9490abda-cdd9-4f23-a1a8-fdc5924186e4', '6c4f8d16-20f2-474c-b3b1-d45f90ad139f', '7975e400-0a93-4aca-807a-9cdeab3e9040'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:50:25 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9e7f6117-2bdf-4f7c-8fb1-09c9fa11d3c3 tempest-VolumeDependencyTests-2006023204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece.b8932587-7ef1-4f98-982f-5b6de21dc615" returned: 0 in 0.924s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9e7f6117-2bdf-4f7c-8fb1-09c9fa11d3c3 tempest-VolumeDependencyTests-2006023204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece.b8932587-7ef1-4f98-982f-5b6de21dc615 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:25 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece.b8932587-7ef1-4f98-982f-5b6de21dc615 Jun 04 06:50:25 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-64179cd1-a05a-4ae5-b3c0-6ddf5a145f29 tempest-VolumeImageDependencyTests-1364941386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-64179cd1-a05a-4ae5-b3c0-6ddf5a145f29 tempest-VolumeImageDependencyTests-1364941386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:25 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-64179cd1-a05a-4ae5-b3c0-6ddf5a145f29 tempest-VolumeImageDependencyTests-1364941386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:50:25 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-64179cd1-a05a-4ae5-b3c0-6ddf5a145f29 tempest-VolumeImageDependencyTests-1364941386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:50:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-64179cd1-a05a-4ae5-b3c0-6ddf5a145f29 tempest-VolumeImageDependencyTests-1364941386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:25 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-64179cd1-a05a-4ae5-b3c0-6ddf5a145f29 tempest-VolumeImageDependencyTests-1364941386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:25 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:50:25 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:26 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0721b00b-903b-43fc-a825-ecbec0bfbb1d tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425.info" returned: 0 in 0.912s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:26 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-0721b00b-903b-43fc-a825-ecbec0bfbb1d tempest-CreateVolumesFromSnapshotTest-886612007 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425.info is being set with open permissions: ugo+rw Jun 04 06:50:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0721b00b-903b-43fc-a825-ecbec0bfbb1d tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:26 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425.info Jun 04 06:50:26 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:26 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9e7f6117-2bdf-4f7c-8fb1-09c9fa11d3c3 tempest-VolumeDependencyTests-2006023204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece.b8932587-7ef1-4f98-982f-5b6de21dc615" returned: 0 in 0.883s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:26 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9e7f6117-2bdf-4f7c-8fb1-09c9fa11d3c3 tempest-VolumeDependencyTests-2006023204 None] Lock "cinder-quobyte-b8932587-7ef1-4f98-982f-5b6de21dc615" released by "_delete_snapshot" :: held 3.746s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:26 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-64179cd1-a05a-4ae5-b3c0-6ddf5a145f29 tempest-VolumeImageDependencyTests-1364941386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.887s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:26 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-64179cd1-a05a-4ae5-b3c0-6ddf5a145f29 tempest-VolumeImageDependencyTests-1364941386 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:50:26 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9e7f6117-2bdf-4f7c-8fb1-09c9fa11d3c3 tempest-VolumeDependencyTests-2006023204 None] Lock "cinder-quobyte-98a465f4-6017-43b4-8760-4bf7380d4ece" released by "delete_snapshot" :: held 3.793s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:26 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-64179cd1-a05a-4ae5-b3c0-6ddf5a145f29 tempest-VolumeImageDependencyTests-1364941386 None] Deleted volume successfully. Jun 04 06:50:26 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-64179cd1-a05a-4ae5-b3c0-6ddf5a145f29 tempest-VolumeImageDependencyTests-1364941386 None] Lock "cinder-e108256e-5745-4b56-af5b-772504d3fe01-delete_volume" released by "delete_volume" :: held 4.122s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:26 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-9e7f6117-2bdf-4f7c-8fb1-09c9fa11d3c3 tempest-VolumeDependencyTests-2006023204 None] Created reservations ['17574e5d-a9e0-4486-9091-b4e6d13a65ea', '43b16962-77c3-415c-b30f-35d28db85dd5', 'e69c3876-2cb7-42d6-b33c-ce9aca477c6c', 'f1048881-4d77-4f04-a9fe-0c31779ed362'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:50:26 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-9e7f6117-2bdf-4f7c-8fb1-09c9fa11d3c3 tempest-VolumeDependencyTests-2006023204 None] Delete snapshot completed successfully. Jun 04 06:50:26 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9e7f6117-2bdf-4f7c-8fb1-09c9fa11d3c3 tempest-VolumeDependencyTests-2006023204 None] Lock "cinder-b8932587-7ef1-4f98-982f-5b6de21dc615-delete_snapshot" released by "delete_snapshot" :: held 4.018s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:26 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-0721b00b-903b-43fc-a825-ecbec0bfbb1d tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425.info" returned: 0 in 0.815s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:26 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-0721b00b-903b-43fc-a825-ecbec0bfbb1d tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.427s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:26 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-0721b00b-903b-43fc-a825-ecbec0bfbb1d tempest-CreateVolumesFromSnapshotTest-886612007 None] Create snapshot completed successfully Jun 04 06:50:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-38565b1c-5fdf-48dc-905e-42db4aefefbb tempest-VolumeDependencyTests-2006023204 None] Acquiring lock "cinder-98a465f4-6017-43b4-8760-4bf7380d4ece-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-38565b1c-5fdf-48dc-905e-42db4aefefbb tempest-VolumeDependencyTests-2006023204 None] Lock "cinder-98a465f4-6017-43b4-8760-4bf7380d4ece-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-38565b1c-5fdf-48dc-905e-42db4aefefbb tempest-VolumeDependencyTests-2006023204 None] Acquiring lock "cinder-quobyte-98a465f4-6017-43b4-8760-4bf7380d4ece" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:27 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-38565b1c-5fdf-48dc-905e-42db4aefefbb tempest-VolumeDependencyTests-2006023204 None] Lock "cinder-quobyte-98a465f4-6017-43b4-8760-4bf7380d4ece" acquired by "delete_volume" :: waited 0.027s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:27 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[0973b73a-a2fd-4d42-b76e-f9394d341969]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:50:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-38565b1c-5fdf-48dc-905e-42db4aefefbb tempest-VolumeDependencyTests-2006023204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:27 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece Jun 04 06:50:27 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:27 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:50:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] Flow 'volume_create_manager' (0b36fa00-037a-429d-9055-a68725109b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:50:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (572ee861-9af2-48cd-ba20-e8dfea406ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (572ee861-9af2-48cd-ba20-e8dfea406ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-253586117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af40fbec-aba9-4374-b7c0-c934476c26e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c643e778524c0d969ba61bd7e235c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:50:28Z,use_quota=True,user_id='538616e44cc0489ea70ced57baa61069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7165c91d-67ff-4ee7-a3d4-43665efe38be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7165c91d-67ff-4ee7-a3d4-43665efe38be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c0e755-0a5c-4fa7-886a-1b7888b51a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c0e755-0a5c-4fa7-886a-1b7888b51a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af40fbec-aba9-4374-b7c0-c934476c26e5', 'volume_name': 'volume-af40fbec-aba9-4374-b7c0-c934476c26e5', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf34fc8-681b-48d1-bd9f-4b0f04e34f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf34fc8-681b-48d1-bd9f-4b0f04e34f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:27 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ae34610-7a1e-4fbb-94d9-6fd596570627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:27 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] Volume af40fbec-aba9-4374-b7c0-c934476c26e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af40fbec-aba9-4374-b7c0-c934476c26e5', 'volume_size': 1} Jun 04 06:50:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-253586117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af40fbec-aba9-4374-b7c0-c934476c26e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c643e778524c0d969ba61bd7e235c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:50:28Z,use_quota=True,user_id='538616e44cc0489ea70ced57baa61069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:50:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] Creating volume af40fbec-aba9-4374-b7c0-c934476c26e5 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:50:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:50:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:50:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:27 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:50:27 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:50:27 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-af40fbec-aba9-4374-b7c0-c934476c26e5 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:27 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-af40fbec-aba9-4374-b7c0-c934476c26e5 1073741824 Jun 04 06:50:27 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:28 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:50:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] Flow 'volume_create_manager' (e8d16b4a-61cb-43a4-9602-349278c908c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:50:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (607e5e05-2543-469c-ae99-9b42bac91033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (607e5e05-2543-469c-ae99-9b42bac91033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-928897994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f42af17-9602-41c2-9b98-bd60101c4e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c643e778524c0d969ba61bd7e235c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:50:28Z,use_quota=True,user_id='538616e44cc0489ea70ced57baa61069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04eefefb-50f3-49e4-b154-4f39e406ebf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04eefefb-50f3-49e4-b154-4f39e406ebf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7c262ec-c6cd-4a98-b993-741f4725df84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7c262ec-c6cd-4a98-b993-741f4725df84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f42af17-9602-41c2-9b98-bd60101c4e1c', 'volume_name': 'volume-7f42af17-9602-41c2-9b98-bd60101c4e1c', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02627d6d-fd09-44b6-b1af-6015b7483948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02627d6d-fd09-44b6-b1af-6015b7483948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:28 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:28 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20f82535-9546-4c95-a9eb-a15253d528c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:28 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] Volume 7f42af17-9602-41c2-9b98-bd60101c4e1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f42af17-9602-41c2-9b98-bd60101c4e1c', 'volume_size': 1} Jun 04 06:50:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-38565b1c-5fdf-48dc-905e-42db4aefefbb tempest-VolumeDependencyTests-2006023204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece" returned: 0 in 1.208s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:28 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-38565b1c-5fdf-48dc-905e-42db4aefefbb tempest-VolumeDependencyTests-2006023204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:28 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece Jun 04 06:50:28 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:50:29 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] Flow 'volume_create_manager' (95f314d4-a700-4ce1-9e5e-c6a1fc31d796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84fc6b4a-7da1-4326-af5d-350089be860c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-af40fbec-aba9-4374-b7c0-c934476c26e5 1073741824" returned: 0 in 1.296s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84fc6b4a-7da1-4326-af5d-350089be860c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1154814008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=557006ca-dbc2-4fa8-b5e8-8905f982c98a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c643e778524c0d969ba61bd7e235c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:50:29Z,use_quota=True,user_id='538616e44cc0489ea70ced57baa61069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9c2b5da-07ae-4e40-b638-def9850b53ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9c2b5da-07ae-4e40-b638-def9850b53ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78579ac0-a434-4963-b2b5-663b5cc16cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78579ac0-a434-4963-b2b5-663b5cc16cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '557006ca-dbc2-4fa8-b5e8-8905f982c98a', 'volume_name': 'volume-557006ca-dbc2-4fa8-b5e8-8905f982c98a', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13feb1bd-7d1c-4e31-8087-ae1460a7f865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13feb1bd-7d1c-4e31-8087-ae1460a7f865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05ad21a2-3dda-462c-83cc-da872b224aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:29 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] Volume 557006ca-dbc2-4fa8-b5e8-8905f982c98a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-557006ca-dbc2-4fa8-b5e8-8905f982c98a', 'volume_size': 1} Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-af40fbec-aba9-4374-b7c0-c934476c26e5 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:29 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-af40fbec-aba9-4374-b7c0-c934476c26e5 Jun 04 06:50:29 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] Flow 'volume_create_manager' (b1431f1e-6534-4e98-a9ab-38883055e321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51b2b365-a5d9-4023-ab49-db16bfe3f4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:29 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51b2b365-a5d9-4023-ab49-db16bfe3f4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-957099430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2862a8a1-af08-4e45-b9c2-34615325ffd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c643e778524c0d969ba61bd7e235c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:50:29Z,use_quota=True,user_id='538616e44cc0489ea70ced57baa61069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dabbe0ed-f992-46a8-8d2b-5ee6ff09ea4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dabbe0ed-f992-46a8-8d2b-5ee6ff09ea4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9adb9c1a-c744-403a-9ba5-8e7f3fad863e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9adb9c1a-c744-403a-9ba5-8e7f3fad863e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2862a8a1-af08-4e45-b9c2-34615325ffd9', 'volume_name': 'volume-2862a8a1-af08-4e45-b9c2-34615325ffd9', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b47a34-a9c6-43f6-930f-9ef4169a56ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b47a34-a9c6-43f6-930f-9ef4169a56ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (546334c6-ee8d-41ef-9b6a-6f92526bbf47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:29 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] Volume 2862a8a1-af08-4e45-b9c2-34615325ffd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2862a8a1-af08-4e45-b9c2-34615325ffd9', 'volume_size': 1} Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-38565b1c-5fdf-48dc-905e-42db4aefefbb tempest-VolumeDependencyTests-2006023204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-98a465f4-6017-43b4-8760-4bf7380d4ece" returned: 0 in 1.075s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-38565b1c-5fdf-48dc-905e-42db4aefefbb tempest-VolumeDependencyTests-2006023204 None] Lock "cinder-quobyte-98a465f4-6017-43b4-8760-4bf7380d4ece" released by "delete_volume" :: held 2.375s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-38565b1c-5fdf-48dc-905e-42db4aefefbb tempest-VolumeDependencyTests-2006023204 None] Created reservations ['05e95417-3053-4c99-9c83-8113f7a851fc', 'a69d6b7e-09a8-40ba-aebe-7eb712bda15e', 'c333d5e1-46c5-4d3d-9a3e-729313d0a96d', 'c41f9475-60c6-48fb-bdf5-9917700a1ef5'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-38565b1c-5fdf-48dc-905e-42db4aefefbb tempest-VolumeDependencyTests-2006023204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-38565b1c-5fdf-48dc-905e-42db4aefefbb tempest-VolumeDependencyTests-2006023204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-38565b1c-5fdf-48dc-905e-42db4aefefbb tempest-VolumeDependencyTests-2006023204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-38565b1c-5fdf-48dc-905e-42db4aefefbb tempest-VolumeDependencyTests-2006023204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-38565b1c-5fdf-48dc-905e-42db4aefefbb tempest-VolumeDependencyTests-2006023204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:29 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-38565b1c-5fdf-48dc-905e-42db4aefefbb tempest-VolumeDependencyTests-2006023204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:29 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:50:29 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:30 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] Flow 'volume_create_manager' (47c34535-e9ab-475a-81db-cee14690251b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ca99731-dbba-498e-8e96-0b6284eadf3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-af40fbec-aba9-4374-b7c0-c934476c26e5" returned: 0 in 0.886s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] <== create_volume: return (2320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.323s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.481s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-928897994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f42af17-9602-41c2-9b98-bd60101c4e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c643e778524c0d969ba61bd7e235c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:50:28Z,use_quota=True,user_id='538616e44cc0489ea70ced57baa61069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] Creating volume 7f42af17-9602-41c2-9b98-bd60101c4e1c {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:50:30 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7f42af17-9602-41c2-9b98-bd60101c4e1c 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ca99731-dbba-498e-8e96-0b6284eadf3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-196256379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=665c526d-760b-4e54-8f3b-afb34670ac79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c643e778524c0d969ba61bd7e235c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:50:30Z,use_quota=True,user_id='538616e44cc0489ea70ced57baa61069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (757a131d-ff06-4bd9-b4da-6bd9197b4359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:30 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7f42af17-9602-41c2-9b98-bd60101c4e1c 1073741824 Jun 04 06:50:30 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (757a131d-ff06-4bd9-b4da-6bd9197b4359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd31485f-67ef-45df-a321-8c0c9999be96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd31485f-67ef-45df-a321-8c0c9999be96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '665c526d-760b-4e54-8f3b-afb34670ac79', 'volume_name': 'volume-665c526d-760b-4e54-8f3b-afb34670ac79', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a4c6aa-0855-445b-b581-37b07f00665c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a4c6aa-0855-445b-b581-37b07f00665c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a64e026-8f1f-4073-86fa-00848d9d23e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:30 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] Volume 665c526d-760b-4e54-8f3b-afb34670ac79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-665c526d-760b-4e54-8f3b-afb34670ac79', 'volume_size': 1} Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ae34610-7a1e-4fbb-94d9-6fd596570627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af40fbec-aba9-4374-b7c0-c934476c26e5', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88668dd4-b555-4c2c-bb11-7ad00fd56b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:30 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] Volume volume-af40fbec-aba9-4374-b7c0-c934476c26e5 (af40fbec-aba9-4374-b7c0-c934476c26e5): created successfully Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88668dd4-b555-4c2c-bb11-7ad00fd56b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] Flow 'volume_create_manager' (0b36fa00-037a-429d-9055-a68725109b19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:50:30 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-e8432601-f799-4f4f-b5ca-5b5b3833d136 tempest-CreateVolumesFromSnapshotTest-886612007 None] Created volume successfully. Jun 04 06:50:30 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-38565b1c-5fdf-48dc-905e-42db4aefefbb tempest-VolumeDependencyTests-2006023204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.627s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-38565b1c-5fdf-48dc-905e-42db4aefefbb tempest-VolumeDependencyTests-2006023204 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:50:30 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-38565b1c-5fdf-48dc-905e-42db4aefefbb tempest-VolumeDependencyTests-2006023204 None] Deleted volume successfully. Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-38565b1c-5fdf-48dc-905e-42db4aefefbb tempest-VolumeDependencyTests-2006023204 None] Lock "cinder-98a465f4-6017-43b4-8760-4bf7380d4ece-delete_volume" released by "delete_volume" :: held 3.322s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d63d9602-9993-4bf1-b90b-1b8ce920afff tempest-VolumeDependencyTests-2006023204 None] Acquiring lock "cinder-cd7f68a3-ed58-469b-98d8-c753b82d44a5-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d63d9602-9993-4bf1-b90b-1b8ce920afff tempest-VolumeDependencyTests-2006023204 None] Lock "cinder-cd7f68a3-ed58-469b-98d8-c753b82d44a5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d63d9602-9993-4bf1-b90b-1b8ce920afff tempest-VolumeDependencyTests-2006023204 None] Acquiring lock "cinder-quobyte-cd7f68a3-ed58-469b-98d8-c753b82d44a5" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d63d9602-9993-4bf1-b90b-1b8ce920afff tempest-VolumeDependencyTests-2006023204 None] Lock "cinder-quobyte-cd7f68a3-ed58-469b-98d8-c753b82d44a5" acquired by "delete_volume" :: waited 0.014s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5137e7-3f1e-4c2a-90ee-0770570d0afd]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d63d9602-9993-4bf1-b90b-1b8ce920afff tempest-VolumeDependencyTests-2006023204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cd7f68a3-ed58-469b-98d8-c753b82d44a5 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:30 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cd7f68a3-ed58-469b-98d8-c753b82d44a5 Jun 04 06:50:30 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:30 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7f42af17-9602-41c2-9b98-bd60101c4e1c 1073741824" returned: 0 in 0.835s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:30 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7f42af17-9602-41c2-9b98-bd60101c4e1c {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:30 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7f42af17-9602-41c2-9b98-bd60101c4e1c Jun 04 06:50:30 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:31 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d63d9602-9993-4bf1-b90b-1b8ce920afff tempest-VolumeDependencyTests-2006023204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cd7f68a3-ed58-469b-98d8-c753b82d44a5" returned: 0 in 0.741s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d63d9602-9993-4bf1-b90b-1b8ce920afff tempest-VolumeDependencyTests-2006023204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cd7f68a3-ed58-469b-98d8-c753b82d44a5 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:31 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cd7f68a3-ed58-469b-98d8-c753b82d44a5 Jun 04 06:50:31 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:31 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7f42af17-9602-41c2-9b98-bd60101c4e1c" returned: 0 in 0.618s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:31 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:50:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.426s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:31 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1154814008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=557006ca-dbc2-4fa8-b5e8-8905f982c98a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c643e778524c0d969ba61bd7e235c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:50:29Z,use_quota=True,user_id='538616e44cc0489ea70ced57baa61069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:50:31 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] Creating volume 557006ca-dbc2-4fa8-b5e8-8905f982c98a {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:50:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:31 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:50:31 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:50:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:31 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:50:31 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:50:31 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-557006ca-dbc2-4fa8-b5e8-8905f982c98a 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:31 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-557006ca-dbc2-4fa8-b5e8-8905f982c98a 1073741824 Jun 04 06:50:31 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:31 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20f82535-9546-4c95-a9eb-a15253d528c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f42af17-9602-41c2-9b98-bd60101c4e1c', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:31 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e46b040-e323-48a2-81d1-3cb5bb09b18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:31 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] Volume volume-7f42af17-9602-41c2-9b98-bd60101c4e1c (7f42af17-9602-41c2-9b98-bd60101c4e1c): created successfully Jun 04 06:50:31 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e46b040-e323-48a2-81d1-3cb5bb09b18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:31 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] Flow 'volume_create_manager' (e8d16b4a-61cb-43a4-9602-349278c908c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:50:31 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-d80d7462-9afa-4c43-bf3d-7d8381ab7aba tempest-CreateVolumesFromSnapshotTest-886612007 None] Created volume successfully. Jun 04 06:50:32 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d63d9602-9993-4bf1-b90b-1b8ce920afff tempest-VolumeDependencyTests-2006023204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-cd7f68a3-ed58-469b-98d8-c753b82d44a5" returned: 0 in 0.616s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:32 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d63d9602-9993-4bf1-b90b-1b8ce920afff tempest-VolumeDependencyTests-2006023204 None] Lock "cinder-quobyte-cd7f68a3-ed58-469b-98d8-c753b82d44a5" released by "delete_volume" :: held 1.398s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:32 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-d63d9602-9993-4bf1-b90b-1b8ce920afff tempest-VolumeDependencyTests-2006023204 None] Created reservations ['c4eed17b-67fe-459a-bc98-d5b7048aaf0b', '5fee55ca-6f9d-4947-85b6-811d0b845891', '58706a71-89ee-4c13-8d2c-fa3b97f2553f', '830fd0dd-d92a-4c23-a0f3-6ac1ab92af8f'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:50:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d63d9602-9993-4bf1-b90b-1b8ce920afff tempest-VolumeDependencyTests-2006023204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d63d9602-9993-4bf1-b90b-1b8ce920afff tempest-VolumeDependencyTests-2006023204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:32 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d63d9602-9993-4bf1-b90b-1b8ce920afff tempest-VolumeDependencyTests-2006023204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:50:32 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-d63d9602-9993-4bf1-b90b-1b8ce920afff tempest-VolumeDependencyTests-2006023204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:50:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-d63d9602-9993-4bf1-b90b-1b8ce920afff tempest-VolumeDependencyTests-2006023204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d63d9602-9993-4bf1-b90b-1b8ce920afff tempest-VolumeDependencyTests-2006023204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:32 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:50:32 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:32 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-557006ca-dbc2-4fa8-b5e8-8905f982c98a 1073741824" returned: 0 in 0.798s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-557006ca-dbc2-4fa8-b5e8-8905f982c98a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:32 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-557006ca-dbc2-4fa8-b5e8-8905f982c98a Jun 04 06:50:32 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:32 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:32 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-d63d9602-9993-4bf1-b90b-1b8ce920afff tempest-VolumeDependencyTests-2006023204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.600s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:32 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-d63d9602-9993-4bf1-b90b-1b8ce920afff tempest-VolumeDependencyTests-2006023204 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:50:32 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-d63d9602-9993-4bf1-b90b-1b8ce920afff tempest-VolumeDependencyTests-2006023204 None] Deleted volume successfully. Jun 04 06:50:32 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-d63d9602-9993-4bf1-b90b-1b8ce920afff tempest-VolumeDependencyTests-2006023204 None] Lock "cinder-cd7f68a3-ed58-469b-98d8-c753b82d44a5-delete_volume" released by "delete_volume" :: held 2.210s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:33 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-557006ca-dbc2-4fa8-b5e8-8905f982c98a" returned: 0 in 0.592s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:33 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:50:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.341s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:33 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-957099430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2862a8a1-af08-4e45-b9c2-34615325ffd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c643e778524c0d969ba61bd7e235c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:50:29Z,use_quota=True,user_id='538616e44cc0489ea70ced57baa61069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:50:33 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] Creating volume 2862a8a1-af08-4e45-b9c2-34615325ffd9 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:50:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:33 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:50:33 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:50:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:33 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:50:33 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:50:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2862a8a1-af08-4e45-b9c2-34615325ffd9 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:33 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05ad21a2-3dda-462c-83cc-da872b224aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-557006ca-dbc2-4fa8-b5e8-8905f982c98a', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:33 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2862a8a1-af08-4e45-b9c2-34615325ffd9 1073741824 Jun 04 06:50:33 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:33 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1769dd2-f23f-4ea4-be25-24094ab22378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:33 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] Volume volume-557006ca-dbc2-4fa8-b5e8-8905f982c98a (557006ca-dbc2-4fa8-b5e8-8905f982c98a): created successfully Jun 04 06:50:33 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1769dd2-f23f-4ea4-be25-24094ab22378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:33 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] Flow 'volume_create_manager' (95f314d4-a700-4ce1-9e5e-c6a1fc31d796) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:50:33 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-52b0c66f-3576-49c8-98e6-af0a7714acea tempest-CreateVolumesFromSnapshotTest-886612007 None] Created volume successfully. Jun 04 06:50:33 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2862a8a1-af08-4e45-b9c2-34615325ffd9 1073741824" returned: 0 in 0.826s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:33 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2862a8a1-af08-4e45-b9c2-34615325ffd9 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:33 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2862a8a1-af08-4e45-b9c2-34615325ffd9 Jun 04 06:50:33 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:34 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2862a8a1-af08-4e45-b9c2-34615325ffd9" returned: 0 in 0.630s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:50:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.370s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-196256379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=665c526d-760b-4e54-8f3b-afb34670ac79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c643e778524c0d969ba61bd7e235c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:50:30Z,use_quota=True,user_id='538616e44cc0489ea70ced57baa61069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:50:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] Creating volume 665c526d-760b-4e54-8f3b-afb34670ac79 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:50:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:50:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:50:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:34 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:50:34 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:50:34 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-665c526d-760b-4e54-8f3b-afb34670ac79 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:34 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (546334c6-ee8d-41ef-9b6a-6f92526bbf47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2862a8a1-af08-4e45-b9c2-34615325ffd9', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:34 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-665c526d-760b-4e54-8f3b-afb34670ac79 1073741824 Jun 04 06:50:34 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:34 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe909e3-c6ba-44c9-bcb8-510dcd018eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:34 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] Volume volume-2862a8a1-af08-4e45-b9c2-34615325ffd9 (2862a8a1-af08-4e45-b9c2-34615325ffd9): created successfully Jun 04 06:50:34 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe909e3-c6ba-44c9-bcb8-510dcd018eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:34 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] Flow 'volume_create_manager' (b1431f1e-6534-4e98-a9ab-38883055e321) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:50:34 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-69b21609-0ade-40dc-a12c-dffe4a473c6c tempest-CreateVolumesFromSnapshotTest-886612007 None] Created volume successfully. Jun 04 06:50:35 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-665c526d-760b-4e54-8f3b-afb34670ac79 1073741824" returned: 0 in 0.794s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-665c526d-760b-4e54-8f3b-afb34670ac79 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:35 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-665c526d-760b-4e54-8f3b-afb34670ac79 Jun 04 06:50:35 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:35 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:50:35 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] Flow 'volume_create_manager' (02a94973-7784-44c6-a08f-c912944bb9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:50:35 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08b0e7cd-a9dc-46ac-a39a-e7eced59fa58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:35 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08b0e7cd-a9dc-46ac-a39a-e7eced59fa58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e13ad152-033d-48ea-a3fe-52351e695ca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bbf7fa6f418471791ab3ed4b57d27ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:50:36Z,use_quota=True,user_id='5ad8cb5e97584d61bb1ce904e9fb80f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:35 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f648435-ee7e-4457-a698-63c89ab55c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:35 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f648435-ee7e-4457-a698-63c89ab55c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:35 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffdec720-4e9c-45cf-be21-0cb7fe3431f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:35 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffdec720-4e9c-45cf-be21-0cb7fe3431f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e13ad152-033d-48ea-a3fe-52351e695ca1', 'volume_name': 'volume-e13ad152-033d-48ea-a3fe-52351e695ca1', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:35 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbaaf525-388a-4d77-98a3-e3defe6c52ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:35 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbaaf525-388a-4d77-98a3-e3defe6c52ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:35 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b650cccd-18d9-4a94-8dd9-cac780e0273e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:35 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] Volume e13ad152-033d-48ea-a3fe-52351e695ca1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e13ad152-033d-48ea-a3fe-52351e695ca1', 'volume_size': 1} Jun 04 06:50:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:35 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-665c526d-760b-4e54-8f3b-afb34670ac79" returned: 0 in 0.620s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:50:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.458s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.155s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e13ad152-033d-48ea-a3fe-52351e695ca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bbf7fa6f418471791ab3ed4b57d27ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:50:36Z,use_quota=True,user_id='5ad8cb5e97584d61bb1ce904e9fb80f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:50:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] Creating volume e13ad152-033d-48ea-a3fe-52351e695ca1 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:50:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:50:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:50:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:35 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:50:35 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:50:35 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e13ad152-033d-48ea-a3fe-52351e695ca1 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:36 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a64e026-8f1f-4073-86fa-00848d9d23e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-665c526d-760b-4e54-8f3b-afb34670ac79', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:36 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e13ad152-033d-48ea-a3fe-52351e695ca1 1073741824 Jun 04 06:50:36 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:36 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6877ca75-dc23-40d9-837e-0ff00f269f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:36 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] Volume volume-665c526d-760b-4e54-8f3b-afb34670ac79 (665c526d-760b-4e54-8f3b-afb34670ac79): created successfully Jun 04 06:50:36 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6877ca75-dc23-40d9-837e-0ff00f269f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:36 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] Flow 'volume_create_manager' (47c34535-e9ab-475a-81db-cee14690251b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:50:36 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-c3d0cd6d-685c-4283-951b-abb488eacbd8 tempest-CreateVolumesFromSnapshotTest-886612007 None] Created volume successfully. Jun 04 06:50:36 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-cee35fb0-ccb6-441c-98ff-74ee223661e3 tempest-CreateVolumesFromSnapshotTest-886612007 None] Acquiring lock "cinder-665c526d-760b-4e54-8f3b-afb34670ac79-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:36 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-cee35fb0-ccb6-441c-98ff-74ee223661e3 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "cinder-665c526d-760b-4e54-8f3b-afb34670ac79-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:36 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-cee35fb0-ccb6-441c-98ff-74ee223661e3 tempest-CreateVolumesFromSnapshotTest-886612007 None] Acquiring lock "cinder-quobyte-665c526d-760b-4e54-8f3b-afb34670ac79" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:36 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-cee35fb0-ccb6-441c-98ff-74ee223661e3 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "cinder-quobyte-665c526d-760b-4e54-8f3b-afb34670ac79" acquired by "delete_volume" :: waited 0.016s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:36 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e13ad152-033d-48ea-a3fe-52351e695ca1 1073741824" returned: 0 in 0.827s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:36 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[8971af77-86ac-44ed-8592-6c93dd2d8019]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:50:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-cee35fb0-ccb6-441c-98ff-74ee223661e3 tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-665c526d-760b-4e54-8f3b-afb34670ac79 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:36 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e13ad152-033d-48ea-a3fe-52351e695ca1 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:36 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e13ad152-033d-48ea-a3fe-52351e695ca1 Jun 04 06:50:36 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:36 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-665c526d-760b-4e54-8f3b-afb34670ac79 Jun 04 06:50:36 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:37 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e13ad152-033d-48ea-a3fe-52351e695ca1" returned: 0 in 0.645s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:37 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:50:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b650cccd-18d9-4a94-8dd9-cac780e0273e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e13ad152-033d-48ea-a3fe-52351e695ca1', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (309a7df4-2337-4dad-b31a-77206a0b6702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:37 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] Volume volume-e13ad152-033d-48ea-a3fe-52351e695ca1 (e13ad152-033d-48ea-a3fe-52351e695ca1): created successfully Jun 04 06:50:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (309a7df4-2337-4dad-b31a-77206a0b6702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:37 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] Flow 'volume_create_manager' (02a94973-7784-44c6-a08f-c912944bb9fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:50:37 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-cee35fb0-ccb6-441c-98ff-74ee223661e3 tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-665c526d-760b-4e54-8f3b-afb34670ac79" returned: 0 in 0.734s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:37 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-cee35fb0-ccb6-441c-98ff-74ee223661e3 tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-665c526d-760b-4e54-8f3b-afb34670ac79 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:37 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-00695d7e-34f5-4b13-a285-ef9a1af057e4 tempest-CinderUnicodeTest-1886865577 None] Created volume successfully. Jun 04 06:50:37 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-665c526d-760b-4e54-8f3b-afb34670ac79 Jun 04 06:50:37 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:38 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-cee35fb0-ccb6-441c-98ff-74ee223661e3 tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-665c526d-760b-4e54-8f3b-afb34670ac79" returned: 0 in 0.617s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:38 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-cee35fb0-ccb6-441c-98ff-74ee223661e3 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "cinder-quobyte-665c526d-760b-4e54-8f3b-afb34670ac79" released by "delete_volume" :: held 1.408s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:38 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-cee35fb0-ccb6-441c-98ff-74ee223661e3 tempest-CreateVolumesFromSnapshotTest-886612007 None] Created reservations ['7fa8df14-e046-4668-b259-f88c6310838d', 'b2a040ba-8645-4729-a573-83c9e6962aee', '6a0da39f-70a2-4fcd-ac76-8a206f923495', '1738363d-1623-4532-953c-e878dbd89c5d'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:50:38 devstack cinder-volume[86069]: DEBUG cinder.volume.flows.manager.create_volume [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 06:50:38 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] Flow 'volume_create_manager' (87dca5f8-ad90-4590-850b-c434a5e8bfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:50:38 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (849b5a48-8fe5-499e-91db-7a9104b2b975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-cee35fb0-ccb6-441c-98ff-74ee223661e3 tempest-CreateVolumesFromSnapshotTest-886612007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-cee35fb0-ccb6-441c-98ff-74ee223661e3 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:38 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-cee35fb0-ccb6-441c-98ff-74ee223661e3 tempest-CreateVolumesFromSnapshotTest-886612007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:50:38 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-cee35fb0-ccb6-441c-98ff-74ee223661e3 tempest-CreateVolumesFromSnapshotTest-886612007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:50:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-cee35fb0-ccb6-441c-98ff-74ee223661e3 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-cee35fb0-ccb6-441c-98ff-74ee223661e3 tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:38 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (849b5a48-8fe5-499e-91db-7a9104b2b975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:50:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-716144747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b28d570-0b05-4a02-8729-81401d023dd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bbf7fa6f418471791ab3ed4b57d27ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:50:38Z,use_quota=True,user_id='5ad8cb5e97584d61bb1ce904e9fb80f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:38 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:50:38 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:38 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (483d6ceb-d7f6-421e-a272-44c88c934ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:38 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (483d6ceb-d7f6-421e-a272-44c88c934ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:38 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9216461f-4e42-42d8-bf99-bd788f8831a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:38 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9216461f-4e42-42d8-bf99-bd788f8831a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b28d570-0b05-4a02-8729-81401d023dd9', 'volume_name': 'volume-7b28d570-0b05-4a02-8729-81401d023dd9', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:38 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f87b32-9384-473e-8cf2-99429b11ea75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:38 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f87b32-9384-473e-8cf2-99429b11ea75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:38 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d26940ff-3a39-4a33-81e4-dfc32fc5d299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:38 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] Volume 7b28d570-0b05-4a02-8729-81401d023dd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b28d570-0b05-4a02-8729-81401d023dd9', 'volume_size': 1} Jun 04 06:50:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:38 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T04:50:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-716144747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b28d570-0b05-4a02-8729-81401d023dd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bbf7fa6f418471791ab3ed4b57d27ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T04:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T04:50:38Z,use_quota=True,user_id='5ad8cb5e97584d61bb1ce904e9fb80f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a37383-4f9a-433d-a4f2-61e0f0ff8098),volume_type_id=76a37383-4f9a-433d-a4f2-61e0f0ff8098)}" {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 06:50:38 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] Creating volume 7b28d570-0b05-4a02-8729-81401d023dd9 {{(pid=86069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 06:50:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:38 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:50:38 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:50:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:38 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] Selected osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 as target Quobyte volume. {{(pid=86069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 06:50:38 devstack cinder-volume[86069]: INFO cinder.volume.drivers.remotefs [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] casted to osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574 Jun 04 06:50:38 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9 1073741824 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:38 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9 1073741824 Jun 04 06:50:38 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:38 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ebad8583-4a2d-4901-8d3c-0a3848e8c8f9 tempest-CreateVolumesFromSnapshotTest-886612007 None] Acquiring lock "cinder-2862a8a1-af08-4e45-b9c2-34615325ffd9-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:38 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ebad8583-4a2d-4901-8d3c-0a3848e8c8f9 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "cinder-2862a8a1-af08-4e45-b9c2-34615325ffd9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ebad8583-4a2d-4901-8d3c-0a3848e8c8f9 tempest-CreateVolumesFromSnapshotTest-886612007 None] Acquiring lock "cinder-quobyte-2862a8a1-af08-4e45-b9c2-34615325ffd9" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:39 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-cee35fb0-ccb6-441c-98ff-74ee223661e3 tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.638s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:39 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-cee35fb0-ccb6-441c-98ff-74ee223661e3 tempest-CreateVolumesFromSnapshotTest-886612007 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:50:39 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-cee35fb0-ccb6-441c-98ff-74ee223661e3 tempest-CreateVolumesFromSnapshotTest-886612007 None] Deleted volume successfully. Jun 04 06:50:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ebad8583-4a2d-4901-8d3c-0a3848e8c8f9 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "cinder-quobyte-2862a8a1-af08-4e45-b9c2-34615325ffd9" acquired by "delete_volume" :: waited 0.029s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:39 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfa9e5b-6f49-470c-8ad4-7e40afc2f2f6]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:50:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ebad8583-4a2d-4901-8d3c-0a3848e8c8f9 tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2862a8a1-af08-4e45-b9c2-34615325ffd9 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:39 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-cee35fb0-ccb6-441c-98ff-74ee223661e3 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "cinder-665c526d-760b-4e54-8f3b-afb34670ac79-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:39 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2862a8a1-af08-4e45-b9c2-34615325ffd9 Jun 04 06:50:39 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:39 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9 1073741824" returned: 0 in 0.848s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:39 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9 Jun 04 06:50:39 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:39 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ebad8583-4a2d-4901-8d3c-0a3848e8c8f9 tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2862a8a1-af08-4e45-b9c2-34615325ffd9" returned: 0 in 0.723s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ebad8583-4a2d-4901-8d3c-0a3848e8c8f9 tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2862a8a1-af08-4e45-b9c2-34615325ffd9 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:39 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2862a8a1-af08-4e45-b9c2-34615325ffd9 Jun 04 06:50:39 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:39 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9" returned: 0 in 0.602s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:39 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'} {{(pid=86069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 06:50:39 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d26940ff-3a39-4a33-81e4-dfc32fc5d299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b28d570-0b05-4a02-8729-81401d023dd9', 'volume_size': 1}' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:39 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d7c920e-27e7-44dc-919b-ec3b83be353c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 06:50:40 devstack cinder-volume[86069]: INFO cinder.volume.flows.manager.create_volume [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] Volume volume-7b28d570-0b05-4a02-8729-81401d023dd9 (7b28d570-0b05-4a02-8729-81401d023dd9): created successfully Jun 04 06:50:40 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d7c920e-27e7-44dc-919b-ec3b83be353c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 06:50:40 devstack cinder-volume[86069]: DEBUG cinder.volume.manager [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] Flow 'volume_create_manager' (87dca5f8-ad90-4590-850b-c434a5e8bfaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 06:50:40 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-78846f50-821b-4722-acf0-d3b71517b6c3 tempest-CinderUnicodeTest-1886865577 None] Created volume successfully. Jun 04 06:50:40 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ebad8583-4a2d-4901-8d3c-0a3848e8c8f9 tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-2862a8a1-af08-4e45-b9c2-34615325ffd9" returned: 0 in 0.617s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:40 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ebad8583-4a2d-4901-8d3c-0a3848e8c8f9 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "cinder-quobyte-2862a8a1-af08-4e45-b9c2-34615325ffd9" released by "delete_volume" :: held 1.388s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:40 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-ebad8583-4a2d-4901-8d3c-0a3848e8c8f9 tempest-CreateVolumesFromSnapshotTest-886612007 None] Created reservations ['e055e5e8-1c44-40dc-ade4-80eb86b1b919', '12d7695f-3386-4b61-afcc-44e3c51558cb', 'dc071513-6230-4b26-b5cd-cc11fbf7364f', 'b7f3d1f9-c83c-4bc9-85b8-fcf9c1334561'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:50:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ebad8583-4a2d-4901-8d3c-0a3848e8c8f9 tempest-CreateVolumesFromSnapshotTest-886612007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ebad8583-4a2d-4901-8d3c-0a3848e8c8f9 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:40 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ebad8583-4a2d-4901-8d3c-0a3848e8c8f9 tempest-CreateVolumesFromSnapshotTest-886612007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:50:40 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ebad8583-4a2d-4901-8d3c-0a3848e8c8f9 tempest-CreateVolumesFromSnapshotTest-886612007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:50:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ebad8583-4a2d-4901-8d3c-0a3848e8c8f9 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ebad8583-4a2d-4901-8d3c-0a3848e8c8f9 tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:40 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:50:40 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f5803a7b-e0e3-40b3-941f-b7bf7aaebcf7 tempest-CinderUnicodeTest-1886865577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f5803a7b-e0e3-40b3-941f-b7bf7aaebcf7 tempest-CinderUnicodeTest-1886865577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:40 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-f5803a7b-e0e3-40b3-941f-b7bf7aaebcf7 tempest-CinderUnicodeTest-1886865577 None] Creating offline snapshot 6e9b293b-7f89-42c6-8bbc-ed6c1a91e484 of volume 7b28d570-0b05-4a02-8729-81401d023dd9 {{(pid=86069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 06:50:40 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee72dc9-6153-489d-a96f-6bb334dfb5a1]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:50:40 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f5803a7b-e0e3-40b3-941f-b7bf7aaebcf7 tempest-CinderUnicodeTest-1886865577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:40 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9 Jun 04 06:50:40 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:41 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ebad8583-4a2d-4901-8d3c-0a3848e8c8f9 tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.648s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:41 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-ebad8583-4a2d-4901-8d3c-0a3848e8c8f9 tempest-CreateVolumesFromSnapshotTest-886612007 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:50:41 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-ebad8583-4a2d-4901-8d3c-0a3848e8c8f9 tempest-CreateVolumesFromSnapshotTest-886612007 None] Deleted volume successfully. Jun 04 06:50:41 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ebad8583-4a2d-4901-8d3c-0a3848e8c8f9 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "cinder-2862a8a1-af08-4e45-b9c2-34615325ffd9-delete_volume" released by "delete_volume" :: held 2.257s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:41 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9157ab11-119e-4703-9e81-630826056bca tempest-CreateVolumesFromSnapshotTest-886612007 None] Acquiring lock "cinder-557006ca-dbc2-4fa8-b5e8-8905f982c98a-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:41 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9157ab11-119e-4703-9e81-630826056bca tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "cinder-557006ca-dbc2-4fa8-b5e8-8905f982c98a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:41 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9157ab11-119e-4703-9e81-630826056bca tempest-CreateVolumesFromSnapshotTest-886612007 None] Acquiring lock "cinder-quobyte-557006ca-dbc2-4fa8-b5e8-8905f982c98a" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:41 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9157ab11-119e-4703-9e81-630826056bca tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "cinder-quobyte-557006ca-dbc2-4fa8-b5e8-8905f982c98a" acquired by "delete_volume" :: waited 0.014s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:41 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[defdba75-84fc-4d88-8eed-b1496ce7551b]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:50:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9157ab11-119e-4703-9e81-630826056bca tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-557006ca-dbc2-4fa8-b5e8-8905f982c98a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:41 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-557006ca-dbc2-4fa8-b5e8-8905f982c98a Jun 04 06:50:41 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:41 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f5803a7b-e0e3-40b3-941f-b7bf7aaebcf7 tempest-CinderUnicodeTest-1886865577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9" returned: 0 in 0.784s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:41 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f5803a7b-e0e3-40b3-941f-b7bf7aaebcf7 tempest-CinderUnicodeTest-1886865577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9.6e9b293b-7f89-42c6-8bbc-ed6c1a91e484 1G {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:41 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9.6e9b293b-7f89-42c6-8bbc-ed6c1a91e484 1G Jun 04 06:50:41 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:42 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9157ab11-119e-4703-9e81-630826056bca tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-557006ca-dbc2-4fa8-b5e8-8905f982c98a" returned: 0 in 0.715s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9157ab11-119e-4703-9e81-630826056bca tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-557006ca-dbc2-4fa8-b5e8-8905f982c98a {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:42 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-557006ca-dbc2-4fa8-b5e8-8905f982c98a Jun 04 06:50:42 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:42 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f5803a7b-e0e3-40b3-941f-b7bf7aaebcf7 tempest-CinderUnicodeTest-1886865577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9.6e9b293b-7f89-42c6-8bbc-ed6c1a91e484 1G" returned: 0 in 0.756s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f5803a7b-e0e3-40b3-941f-b7bf7aaebcf7 tempest-CinderUnicodeTest-1886865577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b28d570-0b05-4a02-8729-81401d023dd9 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9.6e9b293b-7f89-42c6-8bbc-ed6c1a91e484 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:42 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b28d570-0b05-4a02-8729-81401d023dd9 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9.6e9b293b-7f89-42c6-8bbc-ed6c1a91e484 Jun 04 06:50:42 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:42 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9157ab11-119e-4703-9e81-630826056bca tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-557006ca-dbc2-4fa8-b5e8-8905f982c98a" returned: 0 in 0.608s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:42 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9157ab11-119e-4703-9e81-630826056bca tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "cinder-quobyte-557006ca-dbc2-4fa8-b5e8-8905f982c98a" released by "delete_volume" :: held 1.365s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:42 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-9157ab11-119e-4703-9e81-630826056bca tempest-CreateVolumesFromSnapshotTest-886612007 None] Created reservations ['4f8cad6f-2216-4b55-9c3c-1f36dc0b3380', '766a2bc6-618a-4015-a9ed-2aa493db3273', '65c9d7cc-b78a-42fb-b9ca-ce9a6e8f9ee0', '0e4a6a38-d115-4c71-bdbd-1b6513e0dc3b'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:50:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9157ab11-119e-4703-9e81-630826056bca tempest-CreateVolumesFromSnapshotTest-886612007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9157ab11-119e-4703-9e81-630826056bca tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:42 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-9157ab11-119e-4703-9e81-630826056bca tempest-CreateVolumesFromSnapshotTest-886612007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:50:42 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-9157ab11-119e-4703-9e81-630826056bca tempest-CreateVolumesFromSnapshotTest-886612007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:50:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-9157ab11-119e-4703-9e81-630826056bca tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9157ab11-119e-4703-9e81-630826056bca tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:42 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:50:42 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:42 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f5803a7b-e0e3-40b3-941f-b7bf7aaebcf7 tempest-CinderUnicodeTest-1886865577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b28d570-0b05-4a02-8729-81401d023dd9 -F qcow2 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9.6e9b293b-7f89-42c6-8bbc-ed6c1a91e484" returned: 0 in 0.668s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:42 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-f5803a7b-e0e3-40b3-941f-b7bf7aaebcf7 tempest-CinderUnicodeTest-1886865577 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9.6e9b293b-7f89-42c6-8bbc-ed6c1a91e484 is being set with open permissions: ugo+rw Jun 04 06:50:42 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f5803a7b-e0e3-40b3-941f-b7bf7aaebcf7 tempest-CinderUnicodeTest-1886865577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9.6e9b293b-7f89-42c6-8bbc-ed6c1a91e484 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:43 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9.6e9b293b-7f89-42c6-8bbc-ed6c1a91e484 Jun 04 06:50:43 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:43 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9157ab11-119e-4703-9e81-630826056bca tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.608s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:43 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-9157ab11-119e-4703-9e81-630826056bca tempest-CreateVolumesFromSnapshotTest-886612007 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:50:43 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-9157ab11-119e-4703-9e81-630826056bca tempest-CreateVolumesFromSnapshotTest-886612007 None] Deleted volume successfully. Jun 04 06:50:43 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9157ab11-119e-4703-9e81-630826056bca tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "cinder-557006ca-dbc2-4fa8-b5e8-8905f982c98a-delete_volume" released by "delete_volume" :: held 2.190s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:43 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-83f2ba81-63b4-403e-9635-0b7a922ca5d7 tempest-CreateVolumesFromSnapshotTest-886612007 None] Acquiring lock "cinder-7f42af17-9602-41c2-9b98-bd60101c4e1c-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:43 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-83f2ba81-63b4-403e-9635-0b7a922ca5d7 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "cinder-7f42af17-9602-41c2-9b98-bd60101c4e1c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:43 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-83f2ba81-63b4-403e-9635-0b7a922ca5d7 tempest-CreateVolumesFromSnapshotTest-886612007 None] Acquiring lock "cinder-quobyte-7f42af17-9602-41c2-9b98-bd60101c4e1c" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:43 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-83f2ba81-63b4-403e-9635-0b7a922ca5d7 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "cinder-quobyte-7f42af17-9602-41c2-9b98-bd60101c4e1c" acquired by "delete_volume" :: waited 0.017s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:43 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ceffab-589b-4b2e-93a2-acf67f0be4a6]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:50:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-83f2ba81-63b4-403e-9635-0b7a922ca5d7 tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7f42af17-9602-41c2-9b98-bd60101c4e1c {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:43 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f5803a7b-e0e3-40b3-941f-b7bf7aaebcf7 tempest-CinderUnicodeTest-1886865577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9.6e9b293b-7f89-42c6-8bbc-ed6c1a91e484" returned: 0 in 0.625s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:43 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f5803a7b-e0e3-40b3-941f-b7bf7aaebcf7 tempest-CinderUnicodeTest-1886865577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:43 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9.info Jun 04 06:50:43 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:43 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7f42af17-9602-41c2-9b98-bd60101c4e1c Jun 04 06:50:43 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:44 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f5803a7b-e0e3-40b3-941f-b7bf7aaebcf7 tempest-CinderUnicodeTest-1886865577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9.info" returned: 0 in 0.619s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:44 devstack cinder-volume[86069]: WARNING cinder.volume.drivers.remotefs [None req-f5803a7b-e0e3-40b3-941f-b7bf7aaebcf7 tempest-CinderUnicodeTest-1886865577 None] /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9.info is being set with open permissions: ugo+rw Jun 04 06:50:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f5803a7b-e0e3-40b3-941f-b7bf7aaebcf7 tempest-CinderUnicodeTest-1886865577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9.info {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:44 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-83f2ba81-63b4-403e-9635-0b7a922ca5d7 tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7f42af17-9602-41c2-9b98-bd60101c4e1c" returned: 0 in 0.699s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-83f2ba81-63b4-403e-9635-0b7a922ca5d7 tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7f42af17-9602-41c2-9b98-bd60101c4e1c {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:44 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9.info Jun 04 06:50:44 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:44 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7f42af17-9602-41c2-9b98-bd60101c4e1c Jun 04 06:50:44 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:44 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-f5803a7b-e0e3-40b3-941f-b7bf7aaebcf7 tempest-CinderUnicodeTest-1886865577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9.info" returned: 0 in 0.568s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-f5803a7b-e0e3-40b3-941f-b7bf7aaebcf7 tempest-CinderUnicodeTest-1886865577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.114s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:44 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-83f2ba81-63b4-403e-9635-0b7a922ca5d7 tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7f42af17-9602-41c2-9b98-bd60101c4e1c" returned: 0 in 0.604s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:44 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-f5803a7b-e0e3-40b3-941f-b7bf7aaebcf7 tempest-CinderUnicodeTest-1886865577 None] Create snapshot completed successfully Jun 04 06:50:44 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-83f2ba81-63b4-403e-9635-0b7a922ca5d7 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "cinder-quobyte-7f42af17-9602-41c2-9b98-bd60101c4e1c" released by "delete_volume" :: held 1.355s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:44 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-83f2ba81-63b4-403e-9635-0b7a922ca5d7 tempest-CreateVolumesFromSnapshotTest-886612007 None] Created reservations ['b17f11e5-cfb2-4f0b-8165-fedc4e681205', '631ad887-f9d4-4388-88ca-70a889f641b6', '974adbc0-ca37-4a2f-b7a7-20d10262d333', '1b55f36f-6838-430c-a8da-480f631fcfa2'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:50:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-83f2ba81-63b4-403e-9635-0b7a922ca5d7 tempest-CreateVolumesFromSnapshotTest-886612007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-83f2ba81-63b4-403e-9635-0b7a922ca5d7 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:44 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-83f2ba81-63b4-403e-9635-0b7a922ca5d7 tempest-CreateVolumesFromSnapshotTest-886612007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:50:44 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-83f2ba81-63b4-403e-9635-0b7a922ca5d7 tempest-CreateVolumesFromSnapshotTest-886612007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:50:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-83f2ba81-63b4-403e-9635-0b7a922ca5d7 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:44 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-83f2ba81-63b4-403e-9635-0b7a922ca5d7 tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:45 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:50:45 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:45 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-83f2ba81-63b4-403e-9635-0b7a922ca5d7 tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.572s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:45 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-83f2ba81-63b4-403e-9635-0b7a922ca5d7 tempest-CreateVolumesFromSnapshotTest-886612007 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:50:45 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-83f2ba81-63b4-403e-9635-0b7a922ca5d7 tempest-CreateVolumesFromSnapshotTest-886612007 None] Deleted volume successfully. Jun 04 06:50:45 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-83f2ba81-63b4-403e-9635-0b7a922ca5d7 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "cinder-7f42af17-9602-41c2-9b98-bd60101c4e1c-delete_volume" released by "delete_volume" :: held 2.105s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:45 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c3ff4bc5-bc4b-4664-9068-ddd6a4981105 tempest-CreateVolumesFromSnapshotTest-886612007 None] Acquiring lock "cinder-af40fbec-aba9-4374-b7c0-c934476c26e5-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:45 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c3ff4bc5-bc4b-4664-9068-ddd6a4981105 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "cinder-af40fbec-aba9-4374-b7c0-c934476c26e5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:45 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c3ff4bc5-bc4b-4664-9068-ddd6a4981105 tempest-CreateVolumesFromSnapshotTest-886612007 None] Acquiring lock "cinder-quobyte-af40fbec-aba9-4374-b7c0-c934476c26e5" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:45 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c3ff4bc5-bc4b-4664-9068-ddd6a4981105 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "cinder-quobyte-af40fbec-aba9-4374-b7c0-c934476c26e5" acquired by "delete_volume" :: waited 0.013s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:45 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd65ea5-8cb0-45ae-81c2-cecaebfce758]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:50:45 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c3ff4bc5-bc4b-4664-9068-ddd6a4981105 tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-af40fbec-aba9-4374-b7c0-c934476c26e5 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:45 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-af40fbec-aba9-4374-b7c0-c934476c26e5 Jun 04 06:50:45 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:45 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9c47ddfa-0c52-4b67-a8e5-7f3f9a9ef4fc tempest-CinderUnicodeTest-1886865577 None] Acquiring lock "cinder-6e9b293b-7f89-42c6-8bbc-ed6c1a91e484-delete_snapshot" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:46 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9c47ddfa-0c52-4b67-a8e5-7f3f9a9ef4fc tempest-CinderUnicodeTest-1886865577 None] Lock "cinder-6e9b293b-7f89-42c6-8bbc-ed6c1a91e484-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:46 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9c47ddfa-0c52-4b67-a8e5-7f3f9a9ef4fc tempest-CinderUnicodeTest-1886865577 None] Acquiring lock "cinder-quobyte-7b28d570-0b05-4a02-8729-81401d023dd9" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:46 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9c47ddfa-0c52-4b67-a8e5-7f3f9a9ef4fc tempest-CinderUnicodeTest-1886865577 None] Lock "cinder-quobyte-7b28d570-0b05-4a02-8729-81401d023dd9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:46 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9c47ddfa-0c52-4b67-a8e5-7f3f9a9ef4fc tempest-CinderUnicodeTest-1886865577 None] Acquiring lock "cinder-quobyte-6e9b293b-7f89-42c6-8bbc-ed6c1a91e484" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:46 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9c47ddfa-0c52-4b67-a8e5-7f3f9a9ef4fc tempest-CinderUnicodeTest-1886865577 None] Lock "cinder-quobyte-6e9b293b-7f89-42c6-8bbc-ed6c1a91e484" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:46 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-9c47ddfa-0c52-4b67-a8e5-7f3f9a9ef4fc tempest-CinderUnicodeTest-1886865577 None] Deleting offline snapshot 6e9b293b-7f89-42c6-8bbc-ed6c1a91e484 of volume 7b28d570-0b05-4a02-8729-81401d023dd9 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:50:46 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-9c47ddfa-0c52-4b67-a8e5-7f3f9a9ef4fc tempest-CinderUnicodeTest-1886865577 None] snapshot_file for this snap is: volume-7b28d570-0b05-4a02-8729-81401d023dd9.6e9b293b-7f89-42c6-8bbc-ed6c1a91e484 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:50:46 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[59429265-4f0c-4130-a5bc-5b90d9f87717]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:50:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9c47ddfa-0c52-4b67-a8e5-7f3f9a9ef4fc tempest-CinderUnicodeTest-1886865577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9.6e9b293b-7f89-42c6-8bbc-ed6c1a91e484 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:46 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9.6e9b293b-7f89-42c6-8bbc-ed6c1a91e484 Jun 04 06:50:46 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:46 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c3ff4bc5-bc4b-4664-9068-ddd6a4981105 tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-af40fbec-aba9-4374-b7c0-c934476c26e5" returned: 0 in 0.693s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c3ff4bc5-bc4b-4664-9068-ddd6a4981105 tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-af40fbec-aba9-4374-b7c0-c934476c26e5 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:46 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-af40fbec-aba9-4374-b7c0-c934476c26e5 Jun 04 06:50:46 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:46 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9c47ddfa-0c52-4b67-a8e5-7f3f9a9ef4fc tempest-CinderUnicodeTest-1886865577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9.6e9b293b-7f89-42c6-8bbc-ed6c1a91e484" returned: 0 in 0.696s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:46 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-9c47ddfa-0c52-4b67-a8e5-7f3f9a9ef4fc tempest-CinderUnicodeTest-1886865577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b28d570-0b05-4a02-8729-81401d023dd9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:50:46 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6b5b5e-9853-4f14-a9b3-0927d1c1621c]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:50:46 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9c47ddfa-0c52-4b67-a8e5-7f3f9a9ef4fc tempest-CinderUnicodeTest-1886865577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:46 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9 Jun 04 06:50:46 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:47 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c3ff4bc5-bc4b-4664-9068-ddd6a4981105 tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-af40fbec-aba9-4374-b7c0-c934476c26e5" returned: 0 in 0.566s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:47 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c3ff4bc5-bc4b-4664-9068-ddd6a4981105 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "cinder-quobyte-af40fbec-aba9-4374-b7c0-c934476c26e5" released by "delete_volume" :: held 1.306s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:47 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-c3ff4bc5-bc4b-4664-9068-ddd6a4981105 tempest-CreateVolumesFromSnapshotTest-886612007 None] Created reservations ['78bbe9a8-7073-43d2-a0bd-2a3f8f98d7bc', 'e5297e92-9f12-4099-97ae-1df4c9cd463f', '9d58f70d-bee6-49bc-81de-c8958fbd7820', 'a5902117-1c7c-4787-8bda-30a8a98617df'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:50:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c3ff4bc5-bc4b-4664-9068-ddd6a4981105 tempest-CreateVolumesFromSnapshotTest-886612007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c3ff4bc5-bc4b-4664-9068-ddd6a4981105 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:47 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c3ff4bc5-bc4b-4664-9068-ddd6a4981105 tempest-CreateVolumesFromSnapshotTest-886612007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:50:47 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-c3ff4bc5-bc4b-4664-9068-ddd6a4981105 tempest-CreateVolumesFromSnapshotTest-886612007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:50:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-c3ff4bc5-bc4b-4664-9068-ddd6a4981105 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c3ff4bc5-bc4b-4664-9068-ddd6a4981105 tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:47 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:50:47 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:47 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9c47ddfa-0c52-4b67-a8e5-7f3f9a9ef4fc tempest-CinderUnicodeTest-1886865577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9" returned: 0 in 0.711s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9c47ddfa-0c52-4b67-a8e5-7f3f9a9ef4fc tempest-CinderUnicodeTest-1886865577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9.6e9b293b-7f89-42c6-8bbc-ed6c1a91e484 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:47 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9.6e9b293b-7f89-42c6-8bbc-ed6c1a91e484 Jun 04 06:50:47 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:47 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:47 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-c3ff4bc5-bc4b-4664-9068-ddd6a4981105 tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.597s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:47 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-c3ff4bc5-bc4b-4664-9068-ddd6a4981105 tempest-CreateVolumesFromSnapshotTest-886612007 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:50:47 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-c3ff4bc5-bc4b-4664-9068-ddd6a4981105 tempest-CreateVolumesFromSnapshotTest-886612007 None] Deleted volume successfully. Jun 04 06:50:47 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-c3ff4bc5-bc4b-4664-9068-ddd6a4981105 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "cinder-af40fbec-aba9-4374-b7c0-c934476c26e5-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:47 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9be61b73-4ad9-4a17-af3a-78ae8aad1478 tempest-CreateVolumesFromSnapshotTest-886612007 None] Acquiring lock "cinder-bd7c9445-23ca-48c6-b27e-fb23b70f8b5d-delete_snapshot" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:47 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9be61b73-4ad9-4a17-af3a-78ae8aad1478 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "cinder-bd7c9445-23ca-48c6-b27e-fb23b70f8b5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:47 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9be61b73-4ad9-4a17-af3a-78ae8aad1478 tempest-CreateVolumesFromSnapshotTest-886612007 None] Acquiring lock "cinder-quobyte-f6c46ca4-2d02-4945-9ae0-02e46d9bb425" by "delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:47 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9be61b73-4ad9-4a17-af3a-78ae8aad1478 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "cinder-quobyte-f6c46ca4-2d02-4945-9ae0-02e46d9bb425" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:47 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9be61b73-4ad9-4a17-af3a-78ae8aad1478 tempest-CreateVolumesFromSnapshotTest-886612007 None] Acquiring lock "cinder-quobyte-bd7c9445-23ca-48c6-b27e-fb23b70f8b5d" by "_delete_snapshot" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:47 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9be61b73-4ad9-4a17-af3a-78ae8aad1478 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "cinder-quobyte-bd7c9445-23ca-48c6-b27e-fb23b70f8b5d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:47 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-9be61b73-4ad9-4a17-af3a-78ae8aad1478 tempest-CreateVolumesFromSnapshotTest-886612007 None] Deleting offline snapshot bd7c9445-23ca-48c6-b27e-fb23b70f8b5d of volume f6c46ca4-2d02-4945-9ae0-02e46d9bb425 {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 06:50:47 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-9be61b73-4ad9-4a17-af3a-78ae8aad1478 tempest-CreateVolumesFromSnapshotTest-886612007 None] snapshot_file for this snap is: volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425.bd7c9445-23ca-48c6-b27e-fb23b70f8b5d {{(pid=86069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 06:50:48 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[686407d8-862a-491d-879f-6d9c3a0cebcd]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:50:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9be61b73-4ad9-4a17-af3a-78ae8aad1478 tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425.bd7c9445-23ca-48c6-b27e-fb23b70f8b5d {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:48 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425.bd7c9445-23ca-48c6-b27e-fb23b70f8b5d Jun 04 06:50:48 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:48 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9c47ddfa-0c52-4b67-a8e5-7f3f9a9ef4fc tempest-CinderUnicodeTest-1886865577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9.6e9b293b-7f89-42c6-8bbc-ed6c1a91e484" returned: 0 in 0.685s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9c47ddfa-0c52-4b67-a8e5-7f3f9a9ef4fc tempest-CinderUnicodeTest-1886865577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9.6e9b293b-7f89-42c6-8bbc-ed6c1a91e484 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:48 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9.6e9b293b-7f89-42c6-8bbc-ed6c1a91e484 Jun 04 06:50:48 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:48 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9be61b73-4ad9-4a17-af3a-78ae8aad1478 tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425.bd7c9445-23ca-48c6-b27e-fb23b70f8b5d" returned: 0 in 0.689s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:48 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.remotefs [None req-9be61b73-4ad9-4a17-af3a-78ae8aad1478 tempest-CreateVolumesFromSnapshotTest-886612007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 06:50:48 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[b854a649-52f9-4269-9a75-a087fc103856]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:50:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9be61b73-4ad9-4a17-af3a-78ae8aad1478 tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:48 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:48 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9c47ddfa-0c52-4b67-a8e5-7f3f9a9ef4fc tempest-CinderUnicodeTest-1886865577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9.6e9b293b-7f89-42c6-8bbc-ed6c1a91e484" returned: 0 in 0.565s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:48 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425 Jun 04 06:50:48 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:48 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9c47ddfa-0c52-4b67-a8e5-7f3f9a9ef4fc tempest-CinderUnicodeTest-1886865577 None] Lock "cinder-quobyte-6e9b293b-7f89-42c6-8bbc-ed6c1a91e484" released by "_delete_snapshot" :: held 2.795s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:48 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9c47ddfa-0c52-4b67-a8e5-7f3f9a9ef4fc tempest-CinderUnicodeTest-1886865577 None] Lock "cinder-quobyte-7b28d570-0b05-4a02-8729-81401d023dd9" released by "delete_snapshot" :: held 2.817s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:48 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-9c47ddfa-0c52-4b67-a8e5-7f3f9a9ef4fc tempest-CinderUnicodeTest-1886865577 None] Created reservations ['0d8622f2-b190-4f4d-9653-9904e2743e1f', '0faf9d06-4191-461f-bb0e-774525573b33', '4076988c-ff83-4923-a7dc-a095b1bc97b7', 'eb084d1e-9e3d-461f-901a-cf5a990f71b7'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:50:48 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-9c47ddfa-0c52-4b67-a8e5-7f3f9a9ef4fc tempest-CinderUnicodeTest-1886865577 None] Delete snapshot completed successfully. Jun 04 06:50:48 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9c47ddfa-0c52-4b67-a8e5-7f3f9a9ef4fc tempest-CinderUnicodeTest-1886865577 None] Lock "cinder-6e9b293b-7f89-42c6-8bbc-ed6c1a91e484-delete_snapshot" released by "delete_snapshot" :: held 2.943s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:49 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-dd77107a-45c7-417a-b80e-ae371a13616e tempest-CinderUnicodeTest-1886865577 None] Acquiring lock "cinder-7b28d570-0b05-4a02-8729-81401d023dd9-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:49 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-dd77107a-45c7-417a-b80e-ae371a13616e tempest-CinderUnicodeTest-1886865577 None] Lock "cinder-7b28d570-0b05-4a02-8729-81401d023dd9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:49 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-dd77107a-45c7-417a-b80e-ae371a13616e tempest-CinderUnicodeTest-1886865577 None] Acquiring lock "cinder-quobyte-7b28d570-0b05-4a02-8729-81401d023dd9" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:49 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-dd77107a-45c7-417a-b80e-ae371a13616e tempest-CinderUnicodeTest-1886865577 None] Lock "cinder-quobyte-7b28d570-0b05-4a02-8729-81401d023dd9" acquired by "delete_volume" :: waited 0.017s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:49 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a9b652-3e14-4091-9ced-775eabad9c19]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:50:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dd77107a-45c7-417a-b80e-ae371a13616e tempest-CinderUnicodeTest-1886865577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:49 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9 Jun 04 06:50:49 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:49 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9be61b73-4ad9-4a17-af3a-78ae8aad1478 tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425" returned: 0 in 0.724s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9be61b73-4ad9-4a17-af3a-78ae8aad1478 tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425.bd7c9445-23ca-48c6-b27e-fb23b70f8b5d {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:49 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425.bd7c9445-23ca-48c6-b27e-fb23b70f8b5d Jun 04 06:50:49 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:49 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dd77107a-45c7-417a-b80e-ae371a13616e tempest-CinderUnicodeTest-1886865577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9" returned: 0 in 0.691s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:49 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dd77107a-45c7-417a-b80e-ae371a13616e tempest-CinderUnicodeTest-1886865577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:50 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9 Jun 04 06:50:50 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:50 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9be61b73-4ad9-4a17-af3a-78ae8aad1478 tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425.bd7c9445-23ca-48c6-b27e-fb23b70f8b5d" returned: 0 in 0.684s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9be61b73-4ad9-4a17-af3a-78ae8aad1478 tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425.bd7c9445-23ca-48c6-b27e-fb23b70f8b5d {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:50 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425.bd7c9445-23ca-48c6-b27e-fb23b70f8b5d Jun 04 06:50:50 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:50 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dd77107a-45c7-417a-b80e-ae371a13616e tempest-CinderUnicodeTest-1886865577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-7b28d570-0b05-4a02-8729-81401d023dd9" returned: 0 in 0.596s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:50 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-dd77107a-45c7-417a-b80e-ae371a13616e tempest-CinderUnicodeTest-1886865577 None] Lock "cinder-quobyte-7b28d570-0b05-4a02-8729-81401d023dd9" released by "delete_volume" :: held 1.340s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:50 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-dd77107a-45c7-417a-b80e-ae371a13616e tempest-CinderUnicodeTest-1886865577 None] Created reservations ['ab8ce516-b9cc-4ffc-ab3d-801648a73149', 'bac41d19-bc9a-4cc5-b95a-8903de8b5cf4', 'c00c8d48-1931-4633-9520-9bd31681a577', 'd84012a7-20f5-41b1-9ad1-630e9066b0a8'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:50:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-dd77107a-45c7-417a-b80e-ae371a13616e tempest-CinderUnicodeTest-1886865577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-dd77107a-45c7-417a-b80e-ae371a13616e tempest-CinderUnicodeTest-1886865577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:50 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-dd77107a-45c7-417a-b80e-ae371a13616e tempest-CinderUnicodeTest-1886865577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:50:50 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-dd77107a-45c7-417a-b80e-ae371a13616e tempest-CinderUnicodeTest-1886865577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:50:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-dd77107a-45c7-417a-b80e-ae371a13616e tempest-CinderUnicodeTest-1886865577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dd77107a-45c7-417a-b80e-ae371a13616e tempest-CinderUnicodeTest-1886865577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:50 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:50 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-9be61b73-4ad9-4a17-af3a-78ae8aad1478 tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425.bd7c9445-23ca-48c6-b27e-fb23b70f8b5d" returned: 0 in 0.607s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:50 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:50:50 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:50 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9be61b73-4ad9-4a17-af3a-78ae8aad1478 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "cinder-quobyte-bd7c9445-23ca-48c6-b27e-fb23b70f8b5d" released by "_delete_snapshot" :: held 2.803s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:50 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9be61b73-4ad9-4a17-af3a-78ae8aad1478 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "cinder-quobyte-f6c46ca4-2d02-4945-9ae0-02e46d9bb425" released by "delete_snapshot" :: held 2.829s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:50 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-9be61b73-4ad9-4a17-af3a-78ae8aad1478 tempest-CreateVolumesFromSnapshotTest-886612007 None] Created reservations ['983f7d64-3e89-470c-89a5-280be779615b', '2f8ea1e5-4302-40d1-800a-863f72591446', '39a38d61-8766-4d4f-a31d-6f6c6f3eac85', '273ec7a2-6c4c-4ab5-a10c-273e6054d937'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:50:50 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-9be61b73-4ad9-4a17-af3a-78ae8aad1478 tempest-CreateVolumesFromSnapshotTest-886612007 None] Delete snapshot completed successfully. Jun 04 06:50:50 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-9be61b73-4ad9-4a17-af3a-78ae8aad1478 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "cinder-bd7c9445-23ca-48c6-b27e-fb23b70f8b5d-delete_snapshot" released by "delete_snapshot" :: held 2.955s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:51 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a7d93004-106e-4abe-ba8a-3b983b951814 tempest-CreateVolumesFromSnapshotTest-886612007 None] Acquiring lock "cinder-f6c46ca4-2d02-4945-9ae0-02e46d9bb425-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:51 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a7d93004-106e-4abe-ba8a-3b983b951814 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "cinder-f6c46ca4-2d02-4945-9ae0-02e46d9bb425-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:51 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a7d93004-106e-4abe-ba8a-3b983b951814 tempest-CreateVolumesFromSnapshotTest-886612007 None] Acquiring lock "cinder-quobyte-f6c46ca4-2d02-4945-9ae0-02e46d9bb425" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:51 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a7d93004-106e-4abe-ba8a-3b983b951814 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "cinder-quobyte-f6c46ca4-2d02-4945-9ae0-02e46d9bb425" acquired by "delete_volume" :: waited 0.026s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:51 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb033576-af90-41e4-b801-e702c3f7e8bd]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:50:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a7d93004-106e-4abe-ba8a-3b983b951814 tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:51 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425 Jun 04 06:50:51 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:51 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-dd77107a-45c7-417a-b80e-ae371a13616e tempest-CinderUnicodeTest-1886865577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.636s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:51 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-dd77107a-45c7-417a-b80e-ae371a13616e tempest-CinderUnicodeTest-1886865577 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:50:51 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-dd77107a-45c7-417a-b80e-ae371a13616e tempest-CinderUnicodeTest-1886865577 None] Deleted volume successfully. Jun 04 06:50:51 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-dd77107a-45c7-417a-b80e-ae371a13616e tempest-CinderUnicodeTest-1886865577 None] Lock "cinder-7b28d570-0b05-4a02-8729-81401d023dd9-delete_volume" released by "delete_volume" :: held 2.175s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:51 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ed5177de-62b5-4655-9edb-998127e5f219 tempest-CinderUnicodeTest-1886865577 None] Acquiring lock "cinder-e13ad152-033d-48ea-a3fe-52351e695ca1-delete_volume" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:51 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ed5177de-62b5-4655-9edb-998127e5f219 tempest-CinderUnicodeTest-1886865577 None] Lock "cinder-e13ad152-033d-48ea-a3fe-52351e695ca1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:51 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ed5177de-62b5-4655-9edb-998127e5f219 tempest-CinderUnicodeTest-1886865577 None] Acquiring lock "cinder-quobyte-e13ad152-033d-48ea-a3fe-52351e695ca1" by "delete_volume" {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 06:50:51 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ed5177de-62b5-4655-9edb-998127e5f219 tempest-CinderUnicodeTest-1886865577 None] Lock "cinder-quobyte-e13ad152-033d-48ea-a3fe-52351e695ca1" acquired by "delete_volume" :: waited 0.027s {{(pid=86069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 06:50:51 devstack cinder-volume[86069]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c9530b-ad89-4c13-80ea-7ae7568be746]: (4, 'qcow2') {{(pid=87230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 06:50:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ed5177de-62b5-4655-9edb-998127e5f219 tempest-CinderUnicodeTest-1886865577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e13ad152-033d-48ea-a3fe-52351e695ca1 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:51 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e13ad152-033d-48ea-a3fe-52351e695ca1 Jun 04 06:50:51 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:51 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a7d93004-106e-4abe-ba8a-3b983b951814 tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425" returned: 0 in 0.736s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:51 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a7d93004-106e-4abe-ba8a-3b983b951814 tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:51 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425 Jun 04 06:50:51 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:52 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ed5177de-62b5-4655-9edb-998127e5f219 tempest-CinderUnicodeTest-1886865577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e13ad152-033d-48ea-a3fe-52351e695ca1" returned: 0 in 0.693s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ed5177de-62b5-4655-9edb-998127e5f219 tempest-CinderUnicodeTest-1886865577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e13ad152-033d-48ea-a3fe-52351e695ca1 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:52 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e13ad152-033d-48ea-a3fe-52351e695ca1 Jun 04 06:50:52 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:52 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a7d93004-106e-4abe-ba8a-3b983b951814 tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-f6c46ca4-2d02-4945-9ae0-02e46d9bb425" returned: 0 in 0.614s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:52 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a7d93004-106e-4abe-ba8a-3b983b951814 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "cinder-quobyte-f6c46ca4-2d02-4945-9ae0-02e46d9bb425" released by "delete_volume" :: held 1.404s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:52 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-a7d93004-106e-4abe-ba8a-3b983b951814 tempest-CreateVolumesFromSnapshotTest-886612007 None] Created reservations ['bb39bd82-e70b-4b0f-81e1-a5bf8312a656', 'a2e04f01-7df9-4543-8b7c-6bbed3d05292', 'b44cdad4-1298-4bdc-b0d5-ac03c2f3847a', 'd2def1e3-cb31-4ffd-a8af-ec7abb29c53d'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:50:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a7d93004-106e-4abe-ba8a-3b983b951814 tempest-CreateVolumesFromSnapshotTest-886612007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a7d93004-106e-4abe-ba8a-3b983b951814 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:52 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a7d93004-106e-4abe-ba8a-3b983b951814 tempest-CreateVolumesFromSnapshotTest-886612007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:50:52 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-a7d93004-106e-4abe-ba8a-3b983b951814 tempest-CreateVolumesFromSnapshotTest-886612007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:50:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-a7d93004-106e-4abe-ba8a-3b983b951814 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a7d93004-106e-4abe-ba8a-3b983b951814 tempest-CreateVolumesFromSnapshotTest-886612007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:52 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:50:52 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:52 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ed5177de-62b5-4655-9edb-998127e5f219 tempest-CinderUnicodeTest-1886865577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198/volume-e13ad152-033d-48ea-a3fe-52351e695ca1" returned: 0 in 0.601s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:52 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ed5177de-62b5-4655-9edb-998127e5f219 tempest-CinderUnicodeTest-1886865577 None] Lock "cinder-quobyte-e13ad152-033d-48ea-a3fe-52351e695ca1" released by "delete_volume" :: held 1.338s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:52 devstack cinder-volume[86069]: DEBUG cinder.quota [None req-ed5177de-62b5-4655-9edb-998127e5f219 tempest-CinderUnicodeTest-1886865577 None] Created reservations ['5540e987-cc7c-4907-87da-d8c4a3eee99b', 'eafa31ad-09cf-40ee-9da9-c27b8e1acb0e', 'e0ed1f51-df2d-4620-8dc6-6ef30c2b7f7f', '460ecc68-a814-46a4-ba83-f187787c31f1'] {{(pid=86069) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 06:50:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ed5177de-62b5-4655-9edb-998127e5f219 tempest-CinderUnicodeTest-1886865577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 06:50:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ed5177de-62b5-4655-9edb-998127e5f219 tempest-CinderUnicodeTest-1886865577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 06:50:52 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ed5177de-62b5-4655-9edb-998127e5f219 tempest-CinderUnicodeTest-1886865577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574': None} {{(pid=86069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 06:50:52 devstack cinder-volume[86069]: DEBUG cinder.volume.drivers.quobyte [None req-ed5177de-62b5-4655-9edb-998127e5f219 tempest-CinderUnicodeTest-1886865577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fe8057e0-502f-4995-92db-006708b64574'] {{(pid=86069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 06:50:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.lockutils [None req-ed5177de-62b5-4655-9edb-998127e5f219 tempest-CinderUnicodeTest-1886865577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 06:50:52 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ed5177de-62b5-4655-9edb-998127e5f219 tempest-CinderUnicodeTest-1886865577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 06:50:52 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198 Jun 04 06:50:52 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 06:50:53 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-a7d93004-106e-4abe-ba8a-3b983b951814 tempest-CreateVolumesFromSnapshotTest-886612007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.603s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:53 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-a7d93004-106e-4abe-ba8a-3b983b951814 tempest-CreateVolumesFromSnapshotTest-886612007 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:50:53 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-a7d93004-106e-4abe-ba8a-3b983b951814 tempest-CreateVolumesFromSnapshotTest-886612007 None] Deleted volume successfully. Jun 04 06:50:53 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-a7d93004-106e-4abe-ba8a-3b983b951814 tempest-CreateVolumesFromSnapshotTest-886612007 None] Lock "cinder-f6c46ca4-2d02-4945-9ae0-02e46d9bb425-delete_volume" released by "delete_volume" :: held 2.214s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:50:53 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Jun 04 06:50:53 devstack cinder-volume[86069]: DEBUG oslo_concurrency.processutils [None req-ed5177de-62b5-4655-9edb-998127e5f219 tempest-CinderUnicodeTest-1886865577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b2cd41c8bd0d73e931cc99f4f7cb4198" returned: 0 in 0.610s {{(pid=86069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 06:50:53 devstack cinder-volume[86069]: DEBUG cinder.manager [None req-ed5177de-62b5-4655-9edb-998127e5f219 tempest-CinderUnicodeTest-1886865577 None] Notifying Schedulers of capabilities ... {{(pid=86069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 06:50:53 devstack cinder-volume[86069]: INFO cinder.volume.manager [None req-ed5177de-62b5-4655-9edb-998127e5f219 tempest-CinderUnicodeTest-1886865577 None] Deleted volume successfully. Jun 04 06:50:53 devstack cinder-volume[86069]: DEBUG cinder.coordination [None req-ed5177de-62b5-4655-9edb-998127e5f219 tempest-CinderUnicodeTest-1886865577 None] Lock "cinder-e13ad152-033d-48ea-a3fe-52351e695ca1-delete_volume" released by "delete_volume" :: held 2.166s {{(pid=86069) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 06:51:02 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:INSERT=34,cinder:UPDATE=142,cinder:SELECT=88,cinder:DELETE=11 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 06:51:03 devstack cinder-volume[86069]: DEBUG dbcounter [-] [86069] Writing DB stats cinder:SELECT=105,cinder:INSERT=39,cinder:UPDATE=120,cinder:DELETE=11 {{(pid=86069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}